EC2 fleet at first glance


I was working on a project called SpotOn last year. The basically idea is to use Spot fleet whenever possible. If the pool size is lower than the threshold, then CloudWatch will trigger a Lambda function to scale up the on-demand EC2 to pick up the workloads. Check this out if you want to know … Continue reading EC2 fleet at first glance

Advertisements

Run autoscaling group on spot instance in a smart way


Spot fleet is good, but it may not fit every use case. E.g you can not easily shutdown the non-prod environment with spot fleet, due to its scalable target only allows 1 - 3000. In some scenarios, running autoscaling group on spot instance is a better way to go. And essentially, it is all about the … Continue reading Run autoscaling group on spot instance in a smart way

Run Elasticsearch Cluster on Spot Instances


Running Elasticsearch cluster is not cheap, as it generally requires a couple of high spec servers to provides both performances and reliabilities. Below is a typical 3 nodes Elasticsearch cluster that is running on AWS: 3 nodes, one in each availability zone. each node is both master and data node, and it is formed by ec2 … Continue reading Run Elasticsearch Cluster on Spot Instances