お手軽にダウンロードできるCT-AI試験問題集が更新されたのは40問があります [Q13-Q37]

新問題 13
Which ONE of the following options describes a scenario of A/B testing the LEAST?
SELECT ONE OPTION

A comparison of two different websites for the same company to observe from a user acceptance perspective.

A comparison of two different offers in a recommendation system to decide on the more effective offer for same users.

A comparison of the performance of an ML system on two different input datasets.

A comparison of the performance of two different ML implementations on the same input data.

A/B testing, also known as split testing, is a method used to compare two versions of a product or system to determine which one performs better. It is widely used in web development, marketing, and machine learning to optimize user experiences and model performance. Here’s why option C is the least descriptive of an A/B testing scenario:
Understanding A/B Testing:
In A/B testing, two versions (A and B) of a system or feature are tested against each other. The objective is to measure which version performs better based on predefined metrics such as user engagement, conversion rates, or other performance indicators.
Application in Machine Learning:
In ML systems, A/B testing might involve comparing two different models, algorithms, or system configurations on the same set of data to observe which yields better results.
Why Option C is the Least Descriptive:
Option C describes comparing the performance of an ML system on two different input datasets. This scenario focuses on the input data variation rather than the comparison of system versions or features, which is the essence of A/B testing. A/B testing typically involves a controlled experiment with two versions being tested under the same conditions, not different datasets.
Clarifying the Other Options:
A . A comparison of two different websites for the same company to observe from a user acceptance perspective: This is a classic example of A/B testing where two versions of a website are compared.
B . A comparison of two different offers in a recommendation system to decide on the more effective offer for the same users: This is another example of A/B testing in a recommendation system.
D . A comparison of the performance of two different ML implementations on the same input data: This fits the A/B testing model where two implementations are compared under the same conditions.
Reference:
ISTQB CT-AI Syllabus, Section 9.4, A/B Testing, explains the methodology and application of A/B testing in various contexts.
“Understanding A/B Testing” (ISTQB CT-AI Syllabus).

新問題 14
“Splendid Healthcare” has started developing a cancer detection system based on ML. The type of cancer they plan on detecting has 2% prevalence rate in the population of a particular geography. It is required that the model performs well for both normal and cancer patients.
Which ONE of the following combinations requires MAXIMIZATION?
SELECT ONE OPTION

Maximize precision and accuracy

Maximize accuracy and recall

Maximize recall and precision

Maximize specificity number of classes

Prevalence Rate and Model Performance:
The cancer detection system being developed by “Splendid Healthcare” needs to account for the fact that the type of cancer has a 2% prevalence rate in the population. This indicates that the dataset is highly imbalanced with far fewer positive (cancer) cases compared to negative (normal) cases.
Importance of Recall:
Recall, also known as sensitivity or true positive rate, measures the proportion of actual positive cases that are correctly identified by the model. In medical diagnosis, especially cancer detection, recall is critical because missing a positive case (false negative) could have severe consequences for the patient. Therefore, maximizing recall ensures that most, if not all, cancer cases are detected.
Importance of Precision:
Precision measures the proportion of predicted positive cases that are actually positive. High precision reduces the number of false positives, meaning fewer people will be incorrectly diagnosed with cancer. This is also important to avoid unnecessary anxiety and further invasive testing for those who do not have the disease.
Balancing Recall and Precision:
In scenarios where both false negatives and false positives have significant consequences, it is crucial to balance recall and precision. This balance ensures that the model is not only good at detecting positive cases but also accurate in its predictions, reducing both types of errors.
Accuracy and Specificity:
While accuracy (the proportion of total correct predictions) is important, it can be misleading in imbalanced datasets. In this case, high accuracy could simply result from the model predicting the majority class (normal) correctly. Specificity (true negative rate) is also important, but for a cancer detection system, recall and precision take precedence to ensure positive cases are correctly and accurately identified.
Conclusion:
Therefore, for a cancer detection system with a low prevalence rate, maximizing both recall and precision is crucial to ensure effective and accurate detection of cancer cases.

新問題 15
“AllerEgo” is a product that uses sell-learning to predict the behavior of a pilot under combat situation for a variety of terrains and enemy aircraft formations. Post training the model was exposed to the real- world data and the model was found to be behaving poorly. A lot of data quality tests had been performed on the data to bring it into a shape fit for training and testing.
Which ONE of the following options is least likely to describes the possible reason for the fall in the performance, especially when considering the self-learning nature of the Al system?
SELECT ONE OPTION
The difficulty of defining criteria for improvement before the model can be accepted.
The fast pace of change did not allow sufficient time for testing.
The unknown nature and insufficient specification of the operating environment might have caused the poor performance.
There was an algorithmic bias in the Al system.

The difficulty of defining criteria for improvement before the model can be accepted.
Defining criteria for improvement is a challenge in the acceptance of AI models, but it is not directly related to the performance drop in real-world scenarios. It relates more to the evaluation and deployment phase rather than affecting the model’s real-time performance post-deployment.

The fast pace of change did not allow sufficient time for testing.
This can significantly affect the model’s performance. If the system is self-learning, it needs to adapt quickly, and insufficient testing time can lead to incomplete learning and poor performance.

The unknown nature and insufficient specification of the operating environment might have caused the poor performance.
This is highly likely to affect performance. Self-learning AI systems require detailed specifications of the operating environment to adapt and learn effectively. If the environment is insufficiently specified, the model may fail to perform accurately in real-world scenarios.

There was an algorithmic bias in the AI system.Algorithmic bias can significantly impact the performance of AI systems. If the model has biases, it will not perform well across different scenarios and data distributions.

新問題 16
In a certain coffee producing region of Colombia, there have been some severe weather storms, resulting in massive losses in production. This caused a massive drop in stock price of coffee.
Which ONE of the following types of testing SHOULD be performed for a machine learning model for stock-price prediction to detect influence of such phenomenon as above on price of coffee stock.
SELECT ONE OPTION

Testing for accuracy

Testing for bias

Testing for concept drift

Testing for security

新問題 17
Which ONE of the following statements correctly describes the importance of flexibility for Al systems?
SELECT ONE OPTION

Al systems are inherently flexible.

Al systems require changing of operational environments; therefore, flexibility is required.

Flexible Al systems allow for easier modification of the system as a whole.

Self-learning systems are expected to deal with new situations without explicitly having to program for it.

新問題 18
In a conference on artificial intelligence (Al), a speaker made the statement, “The current implementation of Al using models which do NOT change by themselves is NOT true Al*. Based on your understanding of Al, is this above statement CORRECT or INCORRECT and why?
SELECT ONE OPTION

This statement is incorrect. Current Al is true Al and there is no reason to believe that this fact will change over time.

This statement is correct. In general, what is considered Al today may change over time.

This statement is incorrect. What is considered Al today will continue to be Al even as technology evolves and changes.

This statement is correct. In general, today the term Al is utilized incorrectly.

新問題 19
Pairwise testing can be used in the context of self-driving cars for controlling an explosion in the number of combinations of parameters.
Which ONE of the following options is LEAST likely to be a reason for this incredible growth of parameters?
SELECT ONE OPTION

Different Road Types

Different weather conditions

ML model metrics to evaluate the functional performance

Different features like ADAS, Lane Change Assistance etc.

Pairwise testing is used to handle the large number of combinations of parameters that can arise in complex systems like self-driving cars. The question asks which of the given options is least likely to be a reason for the explosion in the number of parameters.
Different Road Types (A): Self-driving cars must operate on various road types, such as highways, city streets, rural roads, etc. Each road type can have different characteristics, requiring the car’s system to adapt and handle different scenarios. Thus, this is a significant factor contributing to the growth of parameters.
Different Weather Conditions (B): Weather conditions such as rain, snow, fog, and bright sunlight significantly affect the performance of self-driving cars. The car’s sensors and algorithms must adapt to these varying conditions, which adds to the number of parameters that need to be considered.
ML Model Metrics to Evaluate Functional Performance (C): While evaluating machine learning (ML) model performance is crucial, it does not directly contribute to the explosion of parameter combinations in the same way that road types, weather conditions, and car features do. Metrics are used to measure and assess performance but are not themselves variable conditions that the system must handle.
Different Features like ADAS, Lane Change Assistance, etc. (D): Advanced Driver Assistance Systems (ADAS) and other features add complexity to self-driving cars. Each feature can have multiple settings and operational modes, contributing to the overall number of parameters.
Hence, the least likely reason for the incredible growth in the number of parameters is C. ML model metrics to evaluate the functional performance.
Reference:
ISTQB CT-AI Syllabus Section 9.2 on Pairwise Testing discusses the application of this technique to manage the combinations of different variables in AI-based systems, including those used in self-driving cars.
Sample Exam Questions document, Question #29 provides context for the explosion in parameter combinations in self-driving cars and highlights the use of pairwise testing as a method to manage this complexity.

新問題 20
Which ONE of the following types of coverage SHOULD be used if test cases need to cause each neuron to achieve both positive and negative activation values?
SELECT ONE OPTION

Value coverage

Threshold coverage

Sign change coverage

Neuron coverage

新問題 21
A ML engineer is trying to determine the correctness of the new open-source implementation *X”, of a supervised regression algorithm implementation. R-Square is one of the functional performance metrics used to determine the quality of the model.
Which ONE of the following would be an APPROPRIATE strategy to achieve this goal?
SELECT ONE OPTION

Add 10% of the rows randomly and create another model and compare the R-Square scores of both the model.

Train various models by changing the order of input features and verify that the R-Square score of these models vary significantly.

Compare the R-Square score of the model obtained using two different implementations that utilize two different programming languages while using the same algorithm and the same training and testing data.

Drop 10% of the rows randomly and create another model and compare the R-Square scores of both the models.

新問題 22
A software component uses machine learning to recognize the digits from a scan of handwritten numbers. In the scenario above, which type of Machine Learning (ML) is this an example of?
SELECT ONE OPTION

Reinforcement learning

Regression

Classification

Clustering

新問題 23
An image classification system is being trained for classifying faces of humans. The distribution of the data is 70% ethnicity A and 30% for ethnicities B, C and D. Based ONLY on the above information, which of the following options BEST describes the situation of this image classification system?
SELECT ONE OPTION

This is an example of expert system bias.

This is an example of sample bias.

This is an example of hyperparameter bias.

This is an example of algorithmic bias.

新問題 24
A company producing consumable goods wants to identify groups of people with similar tastes for the purpose of targeting different products for each group. You have to choose and apply an appropriate ML type for this problem.
Which ONE of the following options represents the BEST possible solution for this above-mentioned task?
SELECT ONE OPTION

Regression

Association

Clustering

Classification

新問題 25
Which ONE of the following approaches to labelling requires the least time and effort?
SELECT ONE OPTION

Outsourced

Pre-labeled dataset

Internal

Al-Assisted

新問題 26
Which ONE of the following options does NOT describe a challenge for acquiring test data in ML systems?
SELECT ONE OPTION

Compliance needs require proper care to be taken of input personal data.

Nature of data constantly changes with lime.

Data for the use case is being generated at a fast pace.

Test data being sourced from public sources.

新問題 27
Which ONE of the following statements is a CORRECT adversarial example in the context of machine learning systems that are working on image classifiers.
SELECT ONE OPTION

Black box attacks based on adversarial examples create an exact duplicate model of the original.

These attack examples cause a model to predict the correct class with slightly less accuracy even though they look like the original image.

These attacks can’t be prevented by retraining the model with these examples augmented to the training data.

These examples are model specific and are not likely to cause another model trained on same task to fail.

新問題 28
Which ONE of the following options BEST DESCRIBES clustering?
SELECT ONE OPTION

Clustering is classification of a continuous quantity.

Clustering is supervised learning.

Clustering is done without prior knowledge of output classes.

Clustering requires you to know the classes.

お手軽にダウンロードできるCT-AI試験問題集が更新されたのは40問があります [Q13-Q37]

コメントを残すコメントをキャンセル

関連認証

CT-AI 練習テスト

最近の投稿

アーカイブ

カテゴリー

お手軽にダウンロードできるCT-AI試験問題集が更新されたのは40問があります [Q13-Q37]

コメントを残す コメントをキャンセル

関連認証

CT-AI 練習テスト

最近の投稿

アーカイブ

カテゴリー

コメントを残すコメントをキャンセル