Amazon Web Services Updated AIF-C01 Exam Questions and Answers by cairo

Diversity in datasets ensures representation of all demographics, reducing bias and improving fairness.

Accuracy is model performance.

Recency bias skews towards recent data.

Reliability measures consistency of results, not representation.

???? Reference:

AWS Responsible AI Guidelines – Data Diversity

Transfer learning is the correct strategy for adapting pre-trained models for new, related tasks without creating models from scratch.

Transfer Learning:

Involves taking a pre-trained model and fine-tuning it on a new dataset for a related task.

This approach is efficient because it leverages existing knowledge from a model trained on a large dataset, requiring less data and computational resources than training a new model from scratch.

Why Option B is Correct:

Adaptation of Pre-trained Models: Allows for adapting existing models to new tasks, which aligns with the company's goal of not starting from scratch.

Efficiency and Speed: Speeds up the model development process by building on the knowledge of pre-trained models.

Why Other Options are Incorrect:

A. Increase the number of epochs: Does not address the strategy of reusing pre-trained models.

C. Decrease the number of epochs: Similarly, does not apply to adapting pre-trained models.

D. Use unsupervised learning: Does not involve using pre-trained models for new tasks.

The correct answer is A because temperature controls the randomness of a language model's output. A higher temperature increases diversity by making the model more likely to explore less probable tokens, while a lower temperature results in more deterministic and repetitive outputs.

From AWS documentation:

"The temperature parameter in LLMs adjusts the randomness of generated responses. Higher values (e.g., 0.8–1.0) produce more creative and diverse output, while lower values (e.g., 0.1–0.3) make output more focused and repetitive."

Explanation of other options:

B. Batch size is related to training efficiency, not output diversity.

C. Learning rate affects the training convergence rate, not inference-time output variety.

D. Optimizer type is a training configuration that influences how the model learns during training, not diversity during inference.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock – Parameter Tuning Guide

AWS Machine Learning Specialty Guide – LLM Inference Parameters

The correct answer is C because BERTScore is a commonly used metric to evaluate the semantic similarity between generated text (like summaries) and reference text. It uses contextual embeddings from BERT to compare generated and reference sentences, making it highly suitable for evaluating generative tasks like summarization.

From AWS documentation:

"Amazon Bedrock supports BERTScore for evaluating generative text tasks, such as summarization or translation, by comparing the semantic similarity between the output and a reference."

Explanation of other options:

A. AUC is used for binary classification models, not generative text.

B. F1 score is also used for classification problems (precision/recall balance).

D. Real World Knowledge (RWK) score is not a standard or supported evaluation metric in Amazon Bedrock.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock Documentation – Model Evaluation Metrics

AWS ML Specialty Guide – Evaluating Generative Models

AWS Generative AI Developer Tools