A Data Scientist Blog¶
AWS CodeBuild local testing
Suppose you have a CodeBuild project triggered by a push on a given branch of a linked CodeCommit repo. If the build is particularly heavy, you might want to ensure its correctness before an actual commit to the related repo - for example, you might be interested in testing the build process specified in buildspec.yml locally.
An introduction to Amazon DynamoDB
An overview of Amazon DynamoDB NoSQL database.
AWS S3 presigned URLs
Solutions to common problems when working with S3 presigned URLs.
How to display AWS CloudWatch logs in Streamlit
Let's dive in the following scenario:
- we have some job/task running on AWS
- we have already built a Streamlit frontend to launch jobs
- we want to monitor AWS CloudWatch logs generated by the job execution
- we don't want to neither switch from our Streamlit frontend to AWS Console, nor become crazy in following right log groups/streams to track our job
A possible custom solution is presented below.
A comparison between AWS Chalice and AWS SAM
AWS Chalice is a microframework for writing serverless apps in Python.
Build Lambda layers with AWS SAM
The AWS Serverless Application Model (AWS SAM) is an open-source framework that you can use to build serverless applications on AWS. A useful tutorial can be found here.
A brief guide to GNU Make
make is a build tool which tracks the dependencies between the
resources it manages, updating the successors whenever a change in one
or more predecessors is detected.
A brief guide to Python's PuLP
PuLP is a Python library for linear programming written in a pythonic way.