Spot instances that stop (or reboot) on their own: a new feature in AWS ?

-
So I have a spot instance for my visualization project. I am using one t1.micro instance in the spot market.

My instance is i-05cabc6a and its spot request is sir-4e01da35. It has a 64 GB EBS volume attached to it (vol-0eba4a7f) and a 8 GB EBS volume for the operating system (vol-b23d42e9). 

According to the EC2 Management Console, its launch time was 2013-06-06 11:00 EDT (314 hours). This is a spot instance, it can not be stopped. It can only be terminated, or obviously it can continue to live too.


 So today I was showing people my visualization project, but it did not work.

 I use http://browser.cloud.raytrek.com/client for the permanent address.

 In the DNS:

 ;; ANSWER SECTION:
browser.cloud.raytrek.com. 14113 IN     CNAME   browser-10.raytrek.com.
browser-10.raytrek.com. 14113   IN      CNAME   ec2-54-226-13-244.compute-1.amazonaws.com.
ec2-54-226-13-244.compute-1.amazonaws.com. 155620 IN A 54.226.13.244
So there was something wrong. I decided from this point to connect to my instance.

 I was surprised to see that the uptime of the operating system on my instance was only 1 day and 20 hours. Today is 2013-06-19, and my spot instance started on 2013-06-06.

 [web@ip-10-125-9-5 ~]$ w
 17:52:05 up 1 day, 20:08,  1 user,  load average: 0.00, 0.01, 0.05
USER     TTY      FROM              LOGIN@   IDLE   JCPU   PCPU WHAT
ec2-user pts/0    132.203.106.196  17:45    5.00s  0.03s  0.01s sshd: ec2-user [priv]
 
My web server was not running neither.

[web@ip-10-125-9-5 ~]$ ps aux|grep lighttpd|grep -v grep

 This the second time that this is happening to me, see my Twitter. A Senior Product Manager from Amazon Web Services even contacted me about this in the past. See the message below (I redacted names and addresses):


Hi Sébastien,

I’m the Sr. Product Manager focusing on Amazon EC2 Spot Instances and I noticed your tweet that your Spot instance was stopped instead of terminated. We definitely didn’t introduce a new feature—I’d love to understand what happened. Would you be willing to share some details to help us figure it out (e.g., Spot instance request id)?

Thanks!
############

########### | Amazon Web Services—EC2 | Sr. Product Manager | #############| ###########

 In my case, starting my stuff takes less than 5 seconds since all my data and software are in Amazon EBS.

 More commands to start Ray Cloud Browser (on TCP port 80):

 [ec2-user@ip-10-125-9-5 ~]$ sudo su
[root@ip-10-125-9-5 ec2-user]# cd /mnt/
[root@ip-10-125-9-5 mnt]# ls
vol-0a34c87b  x
[root@ip-10-125-9-5 mnt]# mkdir vol-0eba4a7f
[root@ip-10-125-9-5 mnt]# mount /dev/sdf vol-0eba4a7f/
[root@ip-10-125-9-5 mnt]# exit
[ec2-user@ip-10-125-9-5 ~]$ sudo su web
find: failed to restore initial working directory: Permission denied
[web@ip-10-125-9-5 ec2-user]$ cd
[web@ip-10-125-9-5 ~]$ ls
Ray-Cloud-Browser-instance
[web@ip-10-125-9-5 ~]$ rm -rf Ray-Cloud-Browser-instance
[web@ip-10-125-9-5 ~]$ ln -s /mnt/vol-0eba4a7f/
lost+found/       vol-0a34c87b.tar  web/             
[web@ip-10-125-9-5 ~]$ ln -s /mnt/vol-0eba4a7f/web/Ray-Cloud-Browser-instance
[web@ip-10-125-9-5 ~]$ ls
Ray-Cloud-Browser-instance
[web@ip-10-125-9-5 ~]$ cd Ray-Cloud-Browser-instance/
[web@ip-10-125-9-5 Ray-Cloud-Browser-instance]$ ls
lighttpd.conf  logs  pid.txt  Ray-Cloud-Browser  Ray-Cloud-Browser-data
[web@ip-10-125-9-5 Ray-Cloud-Browser-instance]$ exit
[ec2-user@ip-10-125-9-5 ~]$ sudo su
[root@ip-10-125-9-5 ec2-user]# cd /home/web/Ray-Cloud-Browser-instance/
[root@ip-10-125-9-5 Ray-Cloud-Browser-instance]# lighttpd -f lighttpd.conf

Comments

Post a Comment

Popular posts from this blog

A survey of the burgeoning industry of cloud genomics

-
Image
I like lists. Here is a list of companies in the cloud genomics industry. Table 1: Companies acting in the industry of cloud genomics. The list is in no particular order. Company Products People Founded Link GenoSpace, LLC - GenoSpace platform - John Quackenbush (CEO) 2011 https://www.genospace.com/ DNAnexus, Inc. - DNAnexus Platform - DNAnexus Platform SDK (a.k.a. dx-toolkit) - Serafim Batzoglou (co-founder) - Andreas Sundquist (co-founder and CTO) - a bunch of other famous people in the field 2009 https://dnanexus.com/ Seven Bridges Genomics, Inc. - IGOR - IGOR Python SDK - Igor Bogicevic (CTO) 2009 https://www.sbgenomics.com/ BGI - EasyGenomics - Xing Xu (Senior Product Manager) Introduced in 2012 https://www.easygenomics.com/ Illumina, Inc. - BaseSpace™ - BaseSpace API - Alex Dickinson (SVP of Cloud Genomics) Introduced in 2011 https://basespace.illumina.com/ Era7 Information Technologies SLU - BG7
Read more

Generating neural machine instructions for multi-head attention

-
  An animal can do training and inference every day of its existence until the day of its death. A forward pass is all you need.   Here is the current model configuration that I use for multi-head attention:         let sequence_length = 6;         let vocab_size = 20;         let n_embd = 64;         let num_heads = 8; You can see the full model here: https://github.com/sebhtml/novigrad/blob/8df6192829edd9cda3a221e12affa770fbda2a1b/src/models/mega_man_attention.rs The struct uses Embedding, MultiHeadAttention, Linear, Softmax: struct MegaManAttentionModel {     input_shape: Vec<usize>,     output_shape: Vec<usize>,     vocab_size: usize,     sequence_length: usize,     embedding: Embedding,     multi_head_attention: MultiHeadAttention,     linear: Linear,     softmax: Softmax, } The instructions generated by Novigrad are below. Notes: - INSTRUCTION    MatMul    t170 t166    t171     means that we do a matrix multiplication between tensors t170 and t166 and the result is wr
Read more

Adding ZVOL VIRTIO disks to a guest running on a host with the FreeBSD BHYVE hypervisor

-
On atlantis.domain (my FreeBSD BHYVE hypervisor host), I use these commands: Install FreeBSD on a 10G disk. vm create -s 10G guestname   vm install FreeBSD-12.1-RELEASE-amd64-memstick.img vm console guestname Add 8 30GB zvol-based disks vm add -d disk -t zvol -s 30G guestname vm add -d disk -t zvol -s 30G guestname vm add -d disk -t zvol -s 30G guestname vm add -d disk -t zvol -s 30G guestname vm add -d disk -t zvol -s 30G guestname vm add -d disk -t zvol -s 30G guestname vm add -d disk -t zvol -s 30G guestname vm add -d disk -t zvol -s 30G guestname You will need to do vm poweroff guestname vm start guestname because the guest does not seem to see the 8 30GB without power cycling. (rebooting won't work) *** If you want the boot disk (the one create by "vm create") to be a zvol, you must edit the template: root@atlantis:~ # zfs snapshot tank/vm-bhyve@2020-06-11-2145 root@atlantis:~ # mount -t zfs tank/vm-bhyve@2020-06-11-2145 /tank/vm-bhyve@2020-06-11-2145 r
Read more