Amazon Web Services Updated AIF-C01 Exam Questions and Answers by ela

Fine-tuning is the process of training a pre-trained LLM with a labeled dataset specific to a desired task—in this case, mapping user messages to JSON outputs. Fine-tuning leverages supervised learning to specialize the model’s outputs.

C is correct:

“Fine-tuning is a supervised learning approach in which a model is further trained on a custom, labeled dataset to adapt to a specific use case.”

(Reference: Amazon Bedrock Fine-Tuning, AWS Certified AI Practitioner Study Guide)

A is incorrect—unsupervised learning does not use labeled data.

B (continued pre-training) uses unlabeled data.

D (RLHF) uses reward signals and human feedback, not direct labeled input/output pairs.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

This scenario describes prompt injection, which is a well-documented security and safety risk in generative AI systems.

Prompt injection occurs when a user intentionally crafts input prompts to override, manipulate, or bypass system instructions, guardrails, or safety policies defined by the AI application developer. The user’s instruction explicitly attempts to override prior system instructions and force the model into unrestricted behavior.

AWS Responsible AI and Generative AI security guidance describe prompt injection as:

An attempt to alter model behavior through malicious or manipulative user input

A risk that can lead to policy violations, unsafe outputs, or data misuse

A key concern when deploying large language models (LLMs) in production systems

Why the other options are incorrect:

Data bias (B) refers to skewed or unrepresentative training data, not user manipulation at inference time.

Hallucination (C) refers to the model generating incorrect or fabricated information.

Data exposure (D) involves leaking sensitive or private data, not instruction hijacking.

AWS AI document references (for exact extracts):

AWS Responsible AI Overview — section on Generative AI risks

Amazon Bedrock Security Best Practices — section on prompt injection and input validation

AWS Generative AI Governance Guidance — discussion of instruction hierarchy and guardrails

The correct answer is C because Amazon Bedrock Guardrails provides out-of-the-box configurable safety mechanisms to control the behavior of LLMs in generative AI applications. Guardrails can be configured with denylists, content filters, sensitive topics, and tone enforcement, all without retraining the model.

From AWS documentation:

"Amazon Bedrock Guardrails allows developers to define safety and responsible AI policies directly in the model inference layer, making it easy to prevent harmful, biased, or unsafe outputs with minimal configuration."

Explanation of other options:

A. Bedrock playgrounds are interactive environments for testing prompts and models but do not provide production-grade safety enforcement.

B. SageMaker Clarify focuses on bias detection and explainability for supervised ML models — it does not directly apply guardrails to LLM outputs.

D. SageMaker JumpStart is for model fine-tuning and deployment, not for enforcing safety policies on LLM responses.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock Documentation – Guardrails Overview

AWS Responsible AI Whitepaper

AWS Certified ML Specialty Study Guide – Safety in Generative AI

Reinforcement learning allows a model to learn and improve over time based on feedback from its environment. In this case, the chatbot can improve its responses by being rewarded for positive customer feedback, which aligns well with the goal of self-improvement based on past interactions and new information.

Option B (Correct): "Reinforcement learning with rewards for positive customer feedback": This is the correct answer as reinforcement learning enables the chatbot to learn from feedback and adapt its behavior accordingly, providing self-improvement capabilities.

Option A: "Supervised learning with a manually curated dataset" is incorrect because it does not support continuous learning from new interactions.

Option C: "Unsupervised learning to find clusters of similar customer inquiries" is incorrect because unsupervised learning does not provide a mechanism for improving responses based on feedback.

Option D: "Supervised learning with a continuously updated FAQ database" is incorrect because it still relies on manually curated data rather than self-improvement from feedback.

AWS AI Practitioner References:

Reinforcement Learning on AWS: AWS provides reinforcement learning frameworks that can be used to train models to improve their performance based on feedback.