Skip to content

Data and machine learning

AI interviews for data scientists, analysts and ML engineers

Talk through your real data and machine learning work with an AI interviewer, then see your results first and choose who sees them. Below: what strong answers show, the 5 practice questions, and a worked example.

  • Free for experts
  • About 15 minutes, whenever you like
  • Type or speak. No camera needed

Retake it up to 3 times: you keep every attempt, and choose which one represents you.

Who it's for

The work it covers

Analytics, data science, machine learning and data engineering.

Example roles

  • Data scientist
  • Data analyst
  • Machine learning engineer
  • Analytics engineer
  • Data engineer
  • Applied scientist
  • MLOps engineer

Name your exact specialty when you apply, and the questions follow it.

Topics the interviewer draws on in data and machine learning

  • A model or analysis that changed a real decision
  • Messy, missing or biased data and how they handled it
  • How they tested a model or analysis before trusting it and what the test missed
  • A model or dashboard that broke or drifted after launch
  • An experiment or A/B test and how they read the results
  • Explaining uncertainty to people who wanted a yes or no answer
  • Choosing between a simple approach and a complex one
  • A pipeline, table or report other people relied on and how they kept it correct

Scoring

What a strong answer shows

These are the words the scoring AI is given for data and machine learning, as written in Aethel's configuration. The scoring AI is told to score an area below 60 when its answers show one of the warning signs, however confident the answer sounds.

Strong work

The candidate checks the data before trusting it, validates the way the work will be used (held-out or time-based tests, a fair baseline), states uncertainty and limits, and shows the effect on a real decision with numbers.

Warning signs

The candidate drops inconvenient data without finding out why, tests a model on the data it was trained on, treats one accuracy number as proof, or cannot say whether anyone used the result.

The four scored areas

  • Problem solving

    Messy data, failures, trade-offs

    Counts as evidence when the candidate describes a specific data or modeling problem, its cause, what they tried, a trade-off, or a measured result.

  • Modeling and analysis

    Methods, metrics, validation

    Counts as evidence when the candidate describes how they built or evaluated a model, analysis or data pipeline: data sources, features, methods, metrics, validation, or how they checked the result was right.

  • Communication

    Explaining findings and their limits

    Counts as evidence when the candidate describes explaining findings or models to other people: a report, a dashboard, a presentation, or walking stakeholders through results and their limits. Answers that respond to the question asked, in a clear order, with a concrete example, also count, but only up to 80 on their own. Grammar, word choice and fluency are never judged.

  • Collaboration

    Stakeholders, engineers, feedback

    Counts as evidence when the candidate describes working with other people: stakeholders, engineers, product partners, reviews, mentoring or feedback. Saying "we" is not, by itself, collaboration evidence.

An area is scored only when the AI can quote you; otherwise it shows Not enough evidence, not a low score. How AI interviews are scored

Practice

The 5 practice questions

Questions like these come up in the interview. The free practice room asks a different set, written for your role and level. The real interview follows up on your own answers instead.

  1. Question 1

    Tell me about an analysis or model you built that someone actually used, and what it changed.

  2. Question 2

    What was wrong or messy about the data, and what did you do about it?

  3. Question 3

    Imagine your model's accuracy drops sharply a month after launch. What would you check first, and why?

  4. Question 4

    How would you explain the uncertainty in your results to a manager who wants a yes or no answer?

  5. Question 5

    What would you improve if you had one more week, and how would you know it worked?

Practice for your role and level

No account. Each answer gets a quick rule check in your browser.

Worked example

One answer, read by the rules

Made up by Aethel to show how the published rules read one answer: not a real candidate, and not scored by the AI. A real score can differ.

The practice question

What was wrong or messy about the data, and what did you do about it?

The made-up answer

The messiest data I've dealt with was for a demand forecast at a regional grocery chain, about 60 stores and 4,000 products, used to set weekly reorder quantities. When I checked the sales history before modeling, about 6 percent of store-product-days showed zero sales, and they were clustered on the best sellers, which made no sense. I joined in the inventory snapshots and found that most of those days had nothing on the shelf. So the zeros were stockouts, not zero demand. The easy fix was to drop those days, but that would have thrown away exactly the high-demand days and pushed the forecast down again, which is how the stockouts kept happening. Instead I flagged them as censored, estimated demand from the same store and weekday in the surrounding weeks, and kept the flag as a feature so the model knew which values were estimates. I tested it on the last 8 weeks, held out by time, against the old moving-average forecast. On the best sellers, forecast error dropped from 31 percent to 22 percent.

Marked words are the quotes the rules would look at.

How the rules read it

  1. The situationLevel 2 of 2

    A specific case with where it was and how big: one forecast for about 60 stores and 4,000 products.

  2. The reasoningLevel 2 of 3

    One alternative weighed against another: dropping the zero days against estimating them, with the risk of the easy fix named.

  3. The resultLevel 2 of 3

    Measured: forecast error on a time-based holdout, against the old forecast as a baseline.

Together the three ratings give 6 of 8 points, which is 87 on the fixed scale. Its longest complete quote has 24 words, so the quote rule does not lower it. It is evidence mainly for Problem solving.

What would raise it

Saying what happened after launch, such as fewer stockouts over the next months, would raise the result. Comparing a second way to handle the zeros, and why it lost, would raise the reasoning.

The same story, told vaguely

The data had a lot of problems, including values that didn't look right. I investigated where they came from, cleaned them up, and handled the missing values carefully so they wouldn't bias the model. After that the forecasts were noticeably better and the business was happy with them.

A case without its context: no business, no size and no number, so situation is 1 and the area is at most 60. 'Noticeably better' is a vague result.

A whole result: the sample software and data result, with a made-up candidate. More examples: strong interview answers.

Company interview links

Roles companies can set up

Starter templates a company can use for an interview link, and what each one steers the interviewer toward.

  • Analytics engineer

    Focus: Data modeling in SQL, transformation tools such as dbt, data tests, shared metric definitions

  • Data analyst

    Focus: SQL, dashboards and reports, checking data quality, explaining results to non-technical teams

  • Data engineer

    Focus: Building data pipelines, batch and streaming data, data quality checks, warehouse design

  • Data scientist

    Focus: Statistics and experiments, predictive modeling, SQL and Python, turning analysis into business decisions

  • Machine learning engineer

    Focus: Training and evaluating models, putting models into production, watching model quality after launch

FAQ

Questions people ask

Should I explain the statistics or the model in detail?

Explain the parts that show how you checked the result: the data, how you validated it, the baseline you compared against, and what the numbers showed. Modeling and analysis evidence is about methods, metrics and validation, so a time-based holdout and the error it gave counts for more than the name of an algorithm.

What if my model or analysis was never used?

You can still talk about it. Say what happened to it, even if it was shelved, and why. The field's warning signs include not being able to say whether anyone used a result, so knowing what happened matters more than a happy ending. A held-out test with numbers still counts as a measured result.

Is it better to talk about a complex model or a simple one?

Talk about the one where you can explain your choices. Reasoning is rated higher when you compare options and say why each was rejected, for example why a simple baseline beat a deeper model on your data, or the reverse. Complexity on its own earns nothing, and treating one accuracy number as proof is a warning sign.

I am an analyst, not a machine learning engineer. Is this the right field?

Yes. This field is for data analysts, data scientists, data engineers and machine learning engineers. Name your exact role as your specialty when you apply, and the questions follow it.

Do I have to share confidential details?

No. The interviewer is told not to ask for names or confidential details about clients, patients, students or employers, and to let you describe situations without identifying anyone. Describe datasets, models and results without sharing anything proprietary.

How to prepare for an AI interview

What this interview cannot do

It is one conversation of about 15 minutes, so it covers only part of what you can do, and we have not tested whether results predict job performance. The AI can misread an answer, which is why every score shows its quotes and people make the decisions. It is not a certification or license check. No independent bias audit has been done. Data and machine learning was one of the 8 fields in our own test (not an audit) of whether non-native English grammar changes scores.

All known limitsYour rights as a candidate