Spot instances that stop (or reboot) on their own: a new feature in AWS ?

-
So I have a spot instance for my visualization project. I am using one t1.micro instance in the spot market.

My instance is i-05cabc6a and its spot request is sir-4e01da35. It has a 64 GB EBS volume attached to it (vol-0eba4a7f) and a 8 GB EBS volume for the operating system (vol-b23d42e9). 

According to the EC2 Management Console, its launch time was 2013-06-06 11:00 EDT (314 hours). This is a spot instance, it can not be stopped. It can only be terminated, or obviously it can continue to live too.


 So today I was showing people my visualization project, but it did not work.

 I use http://browser.cloud.raytrek.com/client for the permanent address.

 In the DNS:

 ;; ANSWER SECTION:
browser.cloud.raytrek.com. 14113 IN     CNAME   browser-10.raytrek.com.
browser-10.raytrek.com. 14113   IN      CNAME   ec2-54-226-13-244.compute-1.amazonaws.com.
ec2-54-226-13-244.compute-1.amazonaws.com. 155620 IN A 54.226.13.244
So there was something wrong. I decided from this point to connect to my instance.

 I was surprised to see that the uptime of the operating system on my instance was only 1 day and 20 hours. Today is 2013-06-19, and my spot instance started on 2013-06-06.

 [web@ip-10-125-9-5 ~]$ w
 17:52:05 up 1 day, 20:08,  1 user,  load average: 0.00, 0.01, 0.05
USER     TTY      FROM              LOGIN@   IDLE   JCPU   PCPU WHAT
ec2-user pts/0    132.203.106.196  17:45    5.00s  0.03s  0.01s sshd: ec2-user [priv]
 
My web server was not running neither.

[web@ip-10-125-9-5 ~]$ ps aux|grep lighttpd|grep -v grep

 This the second time that this is happening to me, see my Twitter. A Senior Product Manager from Amazon Web Services even contacted me about this in the past. See the message below (I redacted names and addresses):


Hi Sébastien,

I’m the Sr. Product Manager focusing on Amazon EC2 Spot Instances and I noticed your tweet that your Spot instance was stopped instead of terminated. We definitely didn’t introduce a new feature—I’d love to understand what happened. Would you be willing to share some details to help us figure it out (e.g., Spot instance request id)?

Thanks!
############

########### | Amazon Web Services—EC2 | Sr. Product Manager | #############| ###########

 In my case, starting my stuff takes less than 5 seconds since all my data and software are in Amazon EBS.

 More commands to start Ray Cloud Browser (on TCP port 80):

 [ec2-user@ip-10-125-9-5 ~]$ sudo su
[root@ip-10-125-9-5 ec2-user]# cd /mnt/
[root@ip-10-125-9-5 mnt]# ls
vol-0a34c87b  x
[root@ip-10-125-9-5 mnt]# mkdir vol-0eba4a7f
[root@ip-10-125-9-5 mnt]# mount /dev/sdf vol-0eba4a7f/
[root@ip-10-125-9-5 mnt]# exit
[ec2-user@ip-10-125-9-5 ~]$ sudo su web
find: failed to restore initial working directory: Permission denied
[web@ip-10-125-9-5 ec2-user]$ cd
[web@ip-10-125-9-5 ~]$ ls
Ray-Cloud-Browser-instance
[web@ip-10-125-9-5 ~]$ rm -rf Ray-Cloud-Browser-instance
[web@ip-10-125-9-5 ~]$ ln -s /mnt/vol-0eba4a7f/
lost+found/       vol-0a34c87b.tar  web/             
[web@ip-10-125-9-5 ~]$ ln -s /mnt/vol-0eba4a7f/web/Ray-Cloud-Browser-instance
[web@ip-10-125-9-5 ~]$ ls
Ray-Cloud-Browser-instance
[web@ip-10-125-9-5 ~]$ cd Ray-Cloud-Browser-instance/
[web@ip-10-125-9-5 Ray-Cloud-Browser-instance]$ ls
lighttpd.conf  logs  pid.txt  Ray-Cloud-Browser  Ray-Cloud-Browser-data
[web@ip-10-125-9-5 Ray-Cloud-Browser-instance]$ exit
[ec2-user@ip-10-125-9-5 ~]$ sudo su
[root@ip-10-125-9-5 ec2-user]# cd /home/web/Ray-Cloud-Browser-instance/
[root@ip-10-125-9-5 Ray-Cloud-Browser-instance]# lighttpd -f lighttpd.conf

Comments

Post a Comment

Popular posts from this blog

Learning to solve the example 1 of puzzle 3aa6fb7a in the ARC prize

-
Image
Hi dear reader, Puzzle rules The example 1 of the puzzle 3aa6fb7a of the ARC prize looks like this: A playout starts with an blank board of width 7 and of height 7. There are therefore 49 cells. Each cell can be blank or can contain one of the 10 possible colors. The colors are identified from 0 to 9.  I added a rule. This rule is that each cell has to be changed exactly once.  The game ends when all cells have been changed. The player wins if all the cell colors match the cell colors in the expected output. Some numbers: Each cell has 11 possible values: 10 colors + blank state There are 49! ( 6.0828186e+62) distinct possible orders of cell changes in a playout.  There are 49!*10 ( 6.0828186e+63) 49 * 10 = 490 possible actions for the first action.  There are 11^49 ( 1.0671896e+51) possible board states The number of possible pairs (s, a) is even larger and upper-bounded by 11^49 * 49 * 10 = 5.2292289e+53 . Given a board state s and a proposed action a, an actio...
Read more

The Thorium actor engine is operational now, we can start to work on actor applications for metagenomics

-
I have been very busy during the last months. In particular, I completed my doctorate on April 10th, 2014 and we moved from Canada to the United States on April 15th, 2014. I started a new occupation on April 21st, 2014 at Argonne National Laboratory (a U.S. Department of Energy laboratory). But the biggest change, perhaps, was not one listed in the enumeration above. The biggest change was to stop working on Ray. Ray is built on top of RayPlatform, which in turn uses MPI for the parallelism and distribution. But this approach is not an easy way of devising applications because message passing alone is a very leaky, not self-contained, abstraction. Ray usually works fine, but it has some bugs . The problem with leaky abstractions is that they lack simplicity and are way too complex to scale out. For example, it is hard to add new code to an existing code base without breaking anything. This is the case because MPI only offers a fixed number of ranks. Sure, the MPI standard has s...
Read more

The source code of SOAPdenovo2 sits in the shadows

-
Update 2012-12-28: SOAPdenovo 2.04-r223 source code was posted online on 2012-12-28. Some minor concerns: 1. The tarball suffers from the bundled library problem (libbam.a and libbammac.a are shipped precompiled). This is incompatible with the GPLv3 license. 2. The Makefile is not portable with its hard-coded paths to compilers (/opt/blc/gcc-4.5.0/bin/gcc should just be gcc). The SOAPdenovo2 article was published today under the terms of the Creative Commons Attribution License. Here are the Availability and requirements for SOAPdenovo2 as reported in the article: Availability and requirements Project name: SOAPdenovo2 Project home page: http://soapdenovo2.sourceforge.net/ Operating system(s): e.g. Platform independent Programming language: C, C++ Other requirements: GCC version ≥ 4.5.0 License: GNU General Public License version 3.0 (GPLv3) Any restrictions to use by non-academics: none Contact: bgi-soap@googlegroups.com I fired up my browser and in a ...
Read more