Questão 28 — Amazon AIF-C01 Simulado | AWS Certified AI Practitioner Questões e Respostas

Which term is the speed at which a pre-trained foundation model (FM) processes requests and delivers output?
  • A. Model size
  • B. Inference latency
  • C. Context window
  • D. Fine-tuning
Resposta correta: B

Explicação

Explanation: Comprehensive and Detailed Explanation From Exact AWS AI documents: Inference latency measures the time it takes for a model to: Receive an input request Process the request Return an output AWS performance guidance emphasizes inference latency as a critical metric for real-time and user- facing AI applications. Why the other options are incorrect: Model size (A) refers to number of parameters. Context window (C) defines input length capacity. Fine-tuning (D) is a customization process. AWS AI document references: Foundation Model Performance Metrics Latency Considerations for AI Applications Optimizing Inference on AWS