SAS® Certified ModelOps Specialist

On this accelerated SAS® Certified ModelOps Specialist course, recognises the growing need in this emerging area, this new credential will help create a standard of knowledge within the area of ModelOps.

Nearly every organization today is on a journey of digital transformation, which requires being able to use data and continuously apply real-time insights to drive business decisions. ModelOps is the practice, or methodology, that has emerged to address this challenge. Inspired by the success of DevOps principles, it enables organizations to take models from the laboratory to deployment in production with precision and efficiency by using analytics and applying data science for business decisioning.

In just 2 days, you’ll learn to define the ModelOps framework. You’ll also learn how to:

• Develop the model proposal.
• Model development and management.
• Model deployment.
• Execute production steps.

At the end of this course, you’ll sit the SAS exam, and achieve your SAS® Certified ModelOps Specialist certification. Through Firebrand’s Lecture | Lab | Review methodology, you’ll get certified at twice the speed of the traditional training and get access to courseware, learn from certified instructors, and train in a distraction-free environment.

 Here are the major content areas for the exam:

Define the ModelOps framework.

Develop the model proposal.

Model development and management.

Model deployment.

Execute production steps.

Audience

This course is ideal for:

• Analytics Lead
• Validation Officer/Analytics
• Application Developer
• Database Experts 

Module 1: Define the ModelOps Framework (18 – 22%)

• Emphasis on governance and stakeholders
• Determine relevant stakeholders based on desired business outcome
• How will collaboration be achieved
• What are standard channels of communication
• Determine the business process workflow
• Outline feedback loops and decision validation
• Articulate handoffs and individual roles/responsibilities
• Establish an approval process
• Create a peer review process
• Validate assumptions
• Review for potential bias
• Test against hold out data
• Adherence to compliance and standards
• Confirm the process is documented
• Create a business review process
• Adherence to compliance and standards
• Verify consumption method
• Make a Go/No-Go decision
• Define audit and tracking needs
• Automated vs. Manual tasks
• Batch vs. OnDemand vs. Streaming
• Identify third party integration points
• CI/CD
• Model development tools
• Git
• Mobile Apps Develop workflow template(s) to execute the process
• Model Type
• Supervised
• Unsupervised
• Scoring Environments
• Cloud
• On-prem o Containers o In-database o Edge

Module 2: Develop Model Proposal (23 – 28%)

• Define the business objective
• Define the business objective
• Explicitly define the target variable
• Assess business impact
• Identify potential consumption methods
• Verify alignment with corporate strategy and policies Associated assets to include
• Cost/benefit analysis
• Optimal business value
• Time to return on investment
• Level of risk
• Caveats/Assumptions
• Finalize consumption method Evaluation against alternative resource allocation Establish preferred deployment method Establish monitoring assessment metrics
• Business outcome metrics
• Optimal model accuracy fit statistics
• Model monitoring frequency and evaluation criteria
• Operational performance metrics

Module 3: Model Development and Management (23 – 28%)

New or Re-build Model Development

• Pre-processing – data extracts and data preparation
• Model training
• Post-processing
• Integration with third party software Model tournament
• Evaluate and compare multiple candidate models
• Utilize fit statistics presented in Business Proposal
• Consider balance of fit vs. model interpretability
• Alignment to corporate ethics and data privacy standards
• Select a champion model Execute peer review Execute business review
• Exporting score code
• Registering a model
• Publish a model Model registration
• Metadata o Input/output variables
• Properties
• Artifacts
• Score code
• Pre/post processing code
• Associated external files and documentation Establish the monitoring process
• Build data extracts for input data
• Create metrics to monitor
• Model metrics
• Business metrics
• System metrics
• Setup thresholds and alerts
• Develop monitoring reports
• Document the process and parameters
• Prepare a model for use in production

Module 4: Model Deployment (18 – 22%)

• Develop the data ingestion pipeline
• Confirm naming conventions/standards used
• Review adherence to architecture standards
• Process request for additional data source (if needed)
• Build data extract for monitoring
• Define production jobs
• Create consumption application(s) (on-demand/streaming)
• Integrate with decisioning process
• Setup scoring, includes pre-/post-processing
• Setup performance data creation
• Setup performance monitoring reports
• Model accuracy
• Business outcome
• Embed alerts
• Develop follow-up actions
• Model updates based on performance monitoring
• Business decisions IT compliance check
• Validate regulatory compliance
• Cross-check against standards/policy Pre-production Testing
• Unit testing
• Regression testing
• Performance testing

Module 5: Production (9 – 12%)

• Execute prep-processing
• Execute scoring/decision
• Execute post-processing
• Execute business actions associated with score/decision
• Execute performance monitoring
• Evaluation
• Diagnose data drift
• Assess model accuracy
• Business outcomes
• Operational impact
• Alerts based on thresholds
• Model update (Recalibrate/Retrain/Rebuild/Retire)

At the end of this accelerated course, you’ll sit the following exam at the Firebrand Training centre, covered Certification Guarantee:

SAS® Certified ModelOps Specialist A00-440 Exam

• Duration: 110 minutes
• Format: multiple choice and short-answer questions
• Number of questions: 65 questions
• Passing score: Passing score is 65%
• Languages: XXX
• Domains:

  • 18-22% - Define the ModelOps Framework.

  • 23-28% - Develop Model Proposal.

  • 23-28% - Model Development and Management.

  • 18-22% - Model Deployment.

  • 18-22% - Production.

There are no prerequisites for this accelerated course.

Your accelerated course includes:

• Accommodation *
• Meals, unlimited snacks, beverages, tea and coffee *
• On-site exams **
• Exam vouchers **
• Practice tests **
• Certification Guarantee ***
• Courseware
• Up-to 12 hours of instructor-led training each day
• 24-hour lab access
• Digital courseware **

* For residential training only. Accommodation is included from the night before the course starts. This doesn't apply for online courses.
** Some exceptions apply. Please refer to the Exam Track or speak with our experts.
*** Pass first time or train again free as many times as it takes, unlimited for 1 year. Just pay for accommodation, exams, and incidental costs.

Seven reasons why you should sit your course with Firebrand Training

• Two options of training. Choose between residential classroom-based, or online courses
• You'll be certified fast. With us, you’ll be trained in record time
• Our course is all-inclusive. A one-off fee covers all course materials, exams**, accommodation* and meals*. No hidden extras.
• Pass the first time or train again for free. This is our guarantee. We’re confident you’ll pass your course the first time. But if not, come back within a year and only pay for accommodation, exams and incidental costs
• You’ll learn more. A day with a traditional training provider generally runs from 9 am – 5 pm, with a nice long break for lunch. With Firebrand Training you’ll get at least 12 hours/day of quality learning time, with your instructor
• You’ll learn faster. Chances are, you’ll have a different learning style to those around you. We combine visual, auditory and tactile styles to deliver the material in a way that ensures you will learn faster and more easily
• You’ll be studying with the best. We’ve been named in the Training Industry’s “Top 20 IT Training Companies of the Year” every year since 2010. As well as winning many more awards, we’ve trained and certified over 135,000 professionals

*For residential training only. Doesn't apply for online courses
**Some exceptions apply. Please refer to the Exam Track or speak with our experts

Think you are ready for the course? Take a FREE practice test to assess your knowledge!  Free Practice Test