Skip to content

stratus broken with boto3 error #575

Description

@yimingsu01

stratus broke again! :)

This time with a ModuleNotFoundError on boto3:

ModuleNotFoundError: No module named 'boto3'
. Retrying in 1 seconds... (Attempt 1/5)
2026-02-17 02:46:38,521 - llm_backend.get_llm_backend - WARNING - OpenAI API error occurred: litellm.APIConnectionError: No module named 'boto3'
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/dist-packages/litellm/main.py", line 3696, in completion
    response = bedrock_converse_chat_completion.completion(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/litellm/llms/bedrock/chat/converse_handler.py", line 312, in completion
    credentials: Credentials = self.get_credentials(
                               ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/litellm/llms/bedrock/base_aws_llm.py", line 264, in get_credentials
    credentials, _cache_ttl = self._auth_with_env_vars()
                              ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/litellm/llms/bedrock/base_aws_llm.py", line 1068, in _auth_with_env_vars
    import boto3
ModuleNotFoundError: No module named 'boto3'
. Retrying in 2 seconds... (Attempt 2/5)
2026-02-17 02:46:40,580 - llm_backend.get_llm_backend - WARNING - OpenAI API error occurred: litellm.APIConnectionError: No module named 'boto3'
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/dist-packages/litellm/main.py", line 3696, in completion
    response = bedrock_converse_chat_completion.completion(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/litellm/llms/bedrock/chat/converse_handler.py", line 312, in completion
    credentials: Credentials = self.get_credentials(
                               ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/litellm/llms/bedrock/base_aws_llm.py", line 264, in get_credentials
    credentials, _cache_ttl = self._auth_with_env_vars()
                              ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/litellm/llms/bedrock/base_aws_llm.py", line 1068, in _auth_with_env_vars
    import boto3
ModuleNotFoundError: No module named 'boto3'
. Retrying in 4 seconds... (Attempt 3/5)
2026-02-17 02:46:44,639 - llm_backend.get_llm_backend - WARNING - OpenAI API error occurred: litellm.APIConnectionError: No module named 'boto3'
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/dist-packages/litellm/main.py", line 3696, in completion
    response = bedrock_converse_chat_completion.completion(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/litellm/llms/bedrock/chat/converse_handler.py", line 312, in completion
    credentials: Credentials = self.get_credentials(
                               ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/litellm/llms/bedrock/base_aws_llm.py", line 264, in get_credentials
    credentials, _cache_ttl = self._auth_with_env_vars()
                              ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/litellm/llms/bedrock/base_aws_llm.py", line 1068, in _auth_with_env_vars
    import boto3
ModuleNotFoundError: No module named 'boto3'
. Retrying in 8 seconds... (Attempt 4/5)

This happens even after I did uv add boto3

yimingsu@node4:~/sregym$ uv add boto3
Resolved 252 packages in 2ms
Audited 249 packages in 5ms

Activity

  1. HacksonClark commented on Feb 17, 2026

    @HacksonClark
    Member

    @yimingsu01 I already have a fix. Need to add boto3 to requirements-container.txt

  2. HacksonClark commented on Feb 17, 2026

    @HacksonClark
    Member

    There's a fix in this branch: claude/issue-244-20260213-2244

  3. self-assigned this
    on Feb 17, 2026
  4. HacksonClark commented on Feb 17, 2026

    @HacksonClark
    Member

    Stratus in bedrock has another issue as well:

      File "/usr/local/lib/python3.12/dist-packages/botocore/session.py", line 424, in get_scoped_config
        raise ProfileNotFound(profile=profile_name)
    botocore.exceptions.ProfileNotFound: The config profile (bedrock) could not be found
    
  5. yimingsu01 commented on Feb 17, 2026

    @yimingsu01
    CollaboratorAuthor

    @HacksonClark is the branch you referenced ready for testing?

  6. HacksonClark commented on Feb 17, 2026

    @HacksonClark
    Member

    @yimingsu01 give it a try

  7. HacksonClark commented on Feb 17, 2026

    @HacksonClark
    Member

    @yimingsu01 Seems like we may need to mount the aws credentials directory when using those credits. Fix for that soon

  8. yimingsu01 commented on Feb 17, 2026

    @yimingsu01
    CollaboratorAuthor

    Was just going to report back that it hasn't been fixed yet

  9. yimingsu01 commented on Feb 17, 2026

    @yimingsu01
    CollaboratorAuthor

    It still complains about not finding boto3

  10. HacksonClark commented on Feb 17, 2026

    @HacksonClark
    Member

    @yimingsu01 Just pushed.

    btw you have to rebuild the container for the changes to take effect with --force-build

  11. yimingsu01 commented on Feb 17, 2026

    @yimingsu01
    CollaboratorAuthor

    Can we force a rebuild by default?

  12. HacksonClark commented on Feb 17, 2026

    @HacksonClark
    Member

    @yimingsu01 why would we do that?

  13. yimingsu01 commented on Feb 17, 2026

    @yimingsu01
    CollaboratorAuthor

    I'm guessing that's not necessary. Closing this issue as the boto3 error is resolved, but there's a new error on the benchmark. Opening a new one to track.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions