Code smartly to avoid exceed AWS request rate


Have your http calls ever been throttled by AWS? If not, congratulations! And if you are curious about what it looks like, here you go: Below is what AWS says about the EC2 request rate limits. The same principal applies to other AWS services, e.g Autoscaling group, in which I encountered the rate exceeded problem. … Continue reading Code smartly to avoid exceed AWS request rate

Run autoscaling group on spot instance in a smart way


Spot fleet is good, but it may not fit every use case. E.g you can not easily shutdown the non-prod environment with spot fleet, due to its scalable target only allows 1 - 3000. In some scenarios, running autoscaling group on spot instance is a better way to go. And essentially, it is all about the … Continue reading Run autoscaling group on spot instance in a smart way

Run Elasticsearch Cluster on Spot Instances


Running Elasticsearch cluster is not cheap, as it generally requires a couple of high spec servers to provides both performances and reliabilities. Below is a typical 3 nodes Elasticsearch cluster that is running on AWS: 3 nodes, one in each availability zone. each node is both master and data node, and it is formed by ec2 … Continue reading Run Elasticsearch Cluster on Spot Instances

Hourly Intermittent Elastic Beanstalk Service Interruption


We noticed that one of our Java applications that is deployed on Elastic Beanstalk has hourly service interruption. Each outage only lasts for about 40 - 60 seconds. By looking at the CloudWatch, the ELB has intermittent 5xx errors every one hour, like 09:01, 10:01, 11:01 ... After some investigations, I found it out that it … Continue reading Hourly Intermittent Elastic Beanstalk Service Interruption