📄 Llama 3 8B Instruct¶

engines.model.llama_3_8b_instruct

type: CrossProviderInferenceEngine
model: llama-3-8b-instruct
[source]

Explanation about CrossProviderInferenceEngine¶

Inference engine capable of dynamically switching between multiple providers APIs.

This class extends the InferenceEngine and OpenAiInferenceEngineParamsMixin to enable seamless integration with various API providers. The supported APIs are specified in _supported_apis, allowing users to interact with multiple models from different sources. The api_model_map dictionary maps each API to specific model identifiers, enabling automatic configuration based on user requests.

Attributes:

provider: Optional; Specifies the current API in use. Must be one of the
literals in _supported_apis.

provider_model_map: Dictionary mapping each supported API to a corresponding
model identifier string. This mapping allows consistent access to models across different API backends.