Tuesday, March 27, 2018

How to Populate Quality Tab in ML Model Inspect page in Oracle Analytics Cloud

In this blog post we will discuss about how to Populate Quality Tab of a Machine Learning Model's Inspect page in OAC.

Assessing quality of a Machine Learning model is an important step in evaluating its performance. Various metrics like RSE, RAE Residuals , R-Squared Adjusted etc help in assessing the quality of the model prediction. If the error metrics are not satisfactory or does not meet user's goals, he/she can tune the model model further till the required level of accuracy is reached. So it is important to expose this quality information of a model in an intuitive and comprehensive fashion so that users can take next course of actions as necessary. Quality tab in Inspect page of ML model in Oracle Analytics Cloud aims to visualize and give complete information on model accuracy details. Here is a snapshot of Quality tab for Linear Regression Model that predicts Bike Rental Count:




In this blog we will talk about how to populate this Quality tab for a custom model. Quality Tab is populated by adding required Related datasets in Train Model script. More details on how to add a related dataset can be found in this blog. Quality tab is auto-populated if user adds the following related datasets:

For Numeric Prediction: If Residuals and Statistics datasets are added as Related datasets in Train Model script, ML framework in OAC takes information from that dataset and populates the Quality tab. Graph is populated using Residuals dataset and all the error metrics are populated using Statistics Dataset. Image shown above shows how Quality tab of a Numeric Prediction model looks like. Here is a sample code that shows how to add Statistics and Residuals Related datasets:

        #residuals dataset
        residuals_mappings = None
        residuals_ds = ModelDataset("Residuals", residuals_df, residuals_mappings)
        model.add_output_dataset(residuals_ds)

        # statistics dataset
        statistics_mappings = None
        statistics_ds = ModelDataset("Statistics", statistics_df, statistics_mappings)
        model.add_output_dataset(statistics_ds)

For Classification: For Binary and Multi-Classification models Confusion Matrix and Statistics Related datasets are used to populate the Quality tab. Here is a sample snapshot of Quality tab for Classification models:



Confusion Matrix Related dataset is used to populate the Confusion matrix table that can be seen in the image and Statistics Related dataset is used to populate the metrics. Here is a sample code that shows how to add Confusion Matrix and Statistics related datasets:
            metrics['Statistics'] = stats
            metrics['Confusion Matrix'] = confMatrix
            ....
            self.add_datasets(metrics=metrics, model=model)

Quality tab is updated automatically if user changes the values of user or model tuning parameters and trains the model. 

Related Blogs: How to build Train/Apply Model Custom Scripts in OAC, How to create Related DatasetsHow to use inbuilt methods in OAC to Prepare data for Training/Applying ML Model 

Are you an Oracle Analytics customer or user?

We want to hear your story!

Please voice your experience and provide feedback with a quick product review for Oracle Analytics Cloud!
 

24 comments:

Unknown said...

Your blog is so nice, and the article is very good it helps to so many people.
Oracle Financials Training in Ameerpet, Hyderabad


latesttechnologyblogs said...

Oracle SOA Online Training

Oracle SOA Online Training Bangalore

Unknown said...


myTectra the Market Leader in Machine Learning Training in Bangalore
myTectra offers Machine Learning Training in Bangalore using Class Room. myTectra offers Live Online Machine Learning Training Globally. Read More

sangeetha sathyan said...

I am very happy to visit your blog. This is definitely helpful to me, eagerly waiting for more updates.
ccna Training in Chennai
ccna institute in Chennai
R Programming Training in Chennai
Python Classes in Chennai
Best Python Training in Chennai
CCNA Training in Anna Nagar
CCNA Training in Porur

jenifer irene said...

It’s really a Great Post .Looking for Some More Stuff
Aviation Academy in Chennai
Air hostess training in Chennai
Airport management courses in Chennai
Ground staff training in Chennai

john seth said...

Thanks for sharingData Mining software service providers

sherlie said...

Very nice post here and thanks for it .I always like and such a super contents of these post.Excellent and very cool idea and great content of different kinds of the valuable information's.
Web Designing Training in Chennai

Web Designing Course in Chennai

Web Designing Training in Bangalore

Web Designing Course in Bangalore

Web Designing Training in Hyderabad

Web Designing Course in Hyderabad

Web Designing Training in Coimbatore

Web Designing Training

Web Designing Online Training

Himachali Khabarnama said...

Annabelle loves to write and has been doing so for many years.Backlink Indexer My GPL Store Teckum-All about Knowledge

Tec said...

IGRS Telangana portal is the all type services provide in telangana state

Tec said...

KGF 2 Release Date : Directed by Prashanth Neel. With Yash, Sanjay Dutt, Raveena Tandon, Prakash Raj. The blood-soaked land of Kolar Gold Fields

lakshmibhucynix said...

Appreciate you sharing, great article.Much thanks again. Really Cool.
best machine learning course online
Machine Learning Online Training In Hyderabad

Unknown said...

I am very happy to visit your blog. This is definitely helpful to me, eagerly waiting for more updates.
oracle fusion hcm training

Unknown said...

I am very happy to visit your blog. This is definitely helpful to me, eagerly waiting for more updates.
oracle fusion hcm training, triotechsoftwaretrainings.com

arbaj said...

i like your post and all your headings are good....hindi skill

Anonymous said...

Mmorpg Oyunları
İnstagram Takipci Satın Al
tiktok jeton hilesi
tiktok jeton hilesi
Antalya Saç Ekim
instagram takipçi satın al
Takipci satin al
metin2 pvp serverlar
instagram takipçi satın al

Anonymous said...

En Son Çıkan Perde Modelleri
sms onay
VODAFONE MOBİL ÖDEME BOZDURMA
nft nasıl alınır
ANKARA EVDEN EVE NAKLİYAT
TRAFİK SİGORTASI
dedektör
Web Sitesi Kurmak
aşk kitapları

Anonymous said...

smm panel
smm panel
İs ilanlari
İnstagram takipçi satın al
hirdavatciburada.com
beyazesyateknikservisi.com.tr
SERVİS
JETON HİLE İNDİR

laxmicynixit said...

nice information thanks for shring............................!
spring boot certification course training

satcharitrasai said...

Very Informative post.
sai satcharitra pdf
Sai Satcharitra telugu pdf
Sai Satcharitra tamil pdf
Sai Satcharitra Hindi pdf
Sai Satcharitra Bengali pdf
Sai Satcharitra Kannada pdf
Sai Satcharitra Marathi pdf
Sai Satcharitra Malayalam pdf
Sai Satcharitra Gujarati pdf

hanumanchalisa said...

Thanks for sharing this useful post

Hanuman Chalisa Lyrics pdf
Hanuman Chalisa Tamil pdf
Hanuman Chalisa English Pdf
Hanuman Chalisa Hindi Pdf
Hanuman Chalisa Bengali Pdf
Hanuman Chalisa Malayalam Pdf
Hanuman Chalisa Gujarati Pdf
Hanuman Chalisa Kannada Pdf

Today news said...

it’s very helpful useful thanks for your valuable information follow us
Data science online training

Mark said...

Thanks for sharing this informative article. If you want to Hire AI/ML Developers for your project. Please visit us.

KAWAKI NEO said...

Director concern test write certain gas window. Pass seat expert director deal science throughout.news today live

KAWAKI NEO said...

Thing medical like mean bring.news headlines

Post a Comment