How to Integrate Amazon AI with CircleCI

January 24, 2025

Streamline your DevOps process with this guide on integrating Amazon AI with CircleCI. Enhance automation and efficiency in your development workflow.

How to Connect Amazon AI to CircleCI: a Simple Guide

Setting Up Your Environment

Create an AWS account if you don't already have one, and set up your IAM credentials for accessing AWS services.

Install the AWS CLI on your local machine and configure it using your AWS credentials. This will allow CircleCI to interact with AWS services using IAM roles.

aws configure

Create an Amazon AI Service

Sign in to the AWS Management Console and navigate to the Amazon AI service you want to use (e.g., Amazon Rekognition, Amazon Comprehend, etc.).

Set up any necessary models or configurations for your chosen Amazon AI service.

Note down any relevant API endpoints and required credentials or setup details for integration.

Configuring CircleCI

Create or access your CircleCI account and navigate to your project's Dashboard.

Ensure your project is linked to a version control system like GitHub or Bitbucket.

Add AWS credentials to CircleCI as environment variables. Navigate to 'Project Settings' > 'Environment Variables' and add your AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY here.

version: 2.1

executors:
  aws-executor:
    docker:
      - image: circleci/python:3.8

jobs:
  build:
    executor: aws-executor
    steps:
      - checkout
      - run:
          name: Install AWS CLI
          command: |
            sudo apt-get -qq update
            sudo apt-get install -y python3-pip
            pip3 install awscli
      - run:
          name: Configure AWS CLI
          command: aws configure list

Writing CircleCI Configurations

Edit the `.circleci/config.yml` file in your project repository to set up your build and deployment process.

Make sure to use AWS CLI commands in your CircleCI jobs to interact with Amazon AI services. This can include invoking APIs or managing AWS resources needed for your AI service.

      - run:
          name: Interact with Amazon AI
          command: |
            aws rekognition detect-labels --image "S3Object={Bucket=<YOUR-BUCKET>,Name=<YOUR-IMAGE>} --region <REGION>"

Trigger and Test Your Workflow

Push changes to your main branch to trigger the CircleCI pipeline and ensure that your configurations are properly set up and executing as expected.

Watch the CircleCI job and logs to confirm that your Amazon AI services are being utilized correctly.

Review the data returned from Amazon AI APIs and ensure smooth operation and integration.

Advanced Considerations

Consider setting up stack-specific IAM roles or policies if your project demands stricter access controls or uses multiple AWS services.

Explore using AWS Lambda with CircleCI for serverless functions that can be triggered as part of your CI/CD pipeline for more extensive AI processing.

      - run:
          name: Trigger Lambda Function
          command: |
            aws lambda invoke --function-name <FUNCTION-NAME> output_file.txt

Omi Necklace

The #1 Open Source AI necklace: Experiment with how you capture and manage conversations.

Build and test with your own Omi.

How to Use Amazon AI with CircleCI: Usecases

Integrating Amazon AI with CircleCI for Automated Image Classification

**Project Setup**: Use Amazon AI services like Amazon Rekognition for image analysis and classification in your application. Setup a GitHub repository to manage your project's source code.

**CI/CD Pipeline Configuration**: Use CircleCI for continuous integration and continuous delivery. Configure CircleCI with your GitHub repository to trigger builds and tests automatically upon new commits or pull requests.

**Image Classification Integration**: Integrate Amazon Rekognition in your application to classify images. This involves setting up the application to call the Rekognition API to analyze images and return classification results.

**Writing Tests**: Create test cases for validating the image classification results. CircleCI will run these tests automatically with each new build.

**Environment Setup on CircleCI**: Ensure that your CircleCI configuration file (.circleci/config.yml) sets up the necessary environment for running Amazon AI services, such as AWS SDK configuration and credentials.

**Automating Deployment**: Once the tests pass, CircleCI can automatically deploy the application to a staging environment for further testing. This can include setting environment variables for the Amazon AI service credentials and endpoints.

**Monitoring and Insights**: Utilize Amazon CloudWatch to monitor the performance and usage of Amazon Rekognition within your application. Visualize and analyze metrics, which help to identify performance bottlenecks or optimization opportunities.

version: 2.1

executors:
  python-executor:
    docker:
      - image: circleci/python:3.8
    environment:
      AWS_DEFAULT_REGION: 'us-west-2'
      AWS_ACCESS_KEY_ID: '<your-access-key-id>'
      AWS_SECRET_ACCESS_KEY: '<your-secret-access-key>'

jobs:
  test:
    executor: python-executor
    steps:
      - checkout
      - run:
          name: Install Dependencies
          command: |
            python -m venv venv
            . venv/bin/activate
            pip install -r requirements.txt
      - run:
          name: Run Tests
          command: |
            . venv/bin/activate
            python -m unittest discover

workflows:
  version: 2
  test_and_deploy:
    jobs:
      - test

Automated Content Moderation using Amazon AI and CircleCI

Project Setup: Leverage Amazon AI services like Amazon Rekognition to develop content moderation features in your application. Initialize a GitHub repository to manage and track your project's changes.

CI/CD Pipeline Configuration: Utilize CircleCI for efficient continuous integration and delivery. Connect CircleCI to your GitHub repository to execute builds and automated tests after every code modification or PR submission.

Content Moderation Integration: Integrate Amazon Rekognition with your application to automate content moderation by detecting inappropriate content in images. This involves programming your application to interact with Rekognition's Moderation API for scanning images.

Writing Tests: Develop unit tests to ensure that content moderation functions correctly, detecting and filtering inappropriate content as intended. Use CircleCI to automatically run these tests as part of the build process.

Environment Setup on CircleCI: Configure your CircleCI `.circleci/config.yml` file to prepare the required environment settings to interact with Amazon AI services. Ensure AWS credentials are securely configured.

Automating Deployment: Upon successful test completion, CircleCI can seamlessly deploy your application to a testing environment. This deployment should include the necessary configurations for Amazon Rekognition API access and monitoring.

Monitoring and Insights: Implement Amazon CloudWatch to gather and review logs and metrics related to the usage and performance of Amazon Rekognition in your application, providing valuable insights for enhancements and debugging.

version: 2.1

executors:
  python-executor:
    docker:
      - image: circleci/python:3.8
    environment:
      AWS_DEFAULT_REGION: 'us-east-1'
      AWS_ACCESS_KEY_ID: '<your-access-key-id>'
      AWS_SECRET_ACCESS_KEY: '<your-secret-access-key>'

jobs:
  test:
    executor: python-executor
    steps:
      - checkout
      - run:
          name: Install Dependencies
          command: |
            python -m venv venv
            . venv/bin/activate
            pip install -r requirements.txt
      - run:
          name: Run Tests
          command: |
            . venv/bin/activate
            python -m unittest discover

workflows:
  version: 2
  test_and_deploy:
    jobs:
      - test