A survey of first order stochastic optimization methods and algorithms based adaptive learning rate from a machine learning perspective

QR Code

A survey of first order stochastic optimization methods and algorithms based adaptive learning rate from a machine learning perspective

Stochastic optimization in machine learning adjusts hyperparameters to reduce cost, which shows difference between actual value of estimated parameter and things predicted by machine learning model. Learning rate regulates the amount of alteration to a model in terms of the predicted error. Tuning l...

Full description

Bibliographic Details
Published in:	AIP Conference Proceedings
Main Author:	Weijuan S.; Shuib A.; Alwadood Z.
Format:	Conference paper
Language:	English
Published:	American Institute of Physics Inc. 2023
Online Access:	https://www.scopus.com/inward/record.uri?eid=2-s2.0-85179818310&doi=10.1063%2f5.0177172&partnerID=40&md5=49e5b9ade56c278e53086eec423de955

Similar Items

Adaptive Step Size Stochastic Runge-Kutta Method of Order 1.5(1.0) for Stochastic Differential Equations (SDEs)
by: Mutalib N.J.A.; Rosli N.; Ariffin N.A.N.
Published: (2023)

House price prediction using a machine learning model: A survey of literature
by: Zulkifley N.H.; Rahman S.A.; Ubaidullah N.H.; Ibrahim I.
Published: (2020)

Hybrid signal processing and machine learning algorithm for adaptive fault classification of wind farm integrated transmission line protection
by: Emmanue O.; Othman M.L.; Hizam H.; Othman M.M.; Aker E.; Okeke Chidiebere A.; Samuel T.N.
Published: (2019)

Development of a machine learning algorithm for fake news detection
by: Abdullah N.A.S.; Rusli N.I.A.; Yuslee N.S.
Published: (2024)

Perspective of virtual machine consolidation in cloud computing: a systematic survey
by: Zou J.; Wang K.; Zhang K.; Kassim M.
Published: (2024)

A Comprehensive Survey on Machine Learning Methods for Handover Optimization in 5G Networks
by: Thillaigovindhan S.K.; Roslee M.; Mitani S.M.I.; Osman A.F.; Ali F.Z.
Published: (2024)

Real time implementation of first order model reference adaptive control (MRAC) without integral on regulating temperature of glycerin bleaching process
by: Jalil M.H.A.; Taib M.N.; Fazalul Rahiman M.H.; Hamdan R.; Marzaki M.H.
Published: (2015)

Detecting ADHD Subjects Using Machine Learning Algorithm
by: Mohd A.; Ali A.M.; Halim S.A.
Published: (2022)

Comparative Analysis of Machine Learning Algorithms Through Visualizations
by: Ismail M.H.; Razak T.R.; Noor N.M.; Aziz A.A.
Published: (2023)

Development of machine learning algorithms in student performance classification based on online learning activities
by: Alias M.A.H.; Aziz M.A.A.; Hambali N.; Taib M.N.
Published: (2024)

First-order three-point boundary value problems at resonance
by: Mohamed M.; Thompson B.; Jusoh M.S.
Published: (2011)

FIRST ORDER DIFFERENTIAL EQUATION SUDORDINATION ASSOCIATED WITH CASSINI CURVE
by: Hern A.L.P.; Omar R.; Janteng A.
Published: (2021)

Applying four machine learning algorithms for employee future prediction
by: Dawd L.N.; Mostafa S.A.; Nawi R.M.; Mahdin H.; Kasim S.; Alkhayyat A.; Ahmad M.; Zainodin M.E.
Published: (2024)

Sentiment Analysis on COVID-19 Vaccine Tweets using Machine Learning and Deep Learning Algorithms
by: Jain T.; Verma V.K.; Sharma A.K.; Saini B.; Purohit N.; Bhavika; Mahdin H.; Ahmad M.; Darman R.; Haw S.-C.; Shaharudin S.M.; Arshad M.S.
Published: (2023)

A Comparative Study of Gaussian Process Machine Learning and Time Series Analysis Techniques for Predicting Unemployment Rate
by: Aris M.N.M.; Nagaratnam S.; Zakaria N.N.; Mohd Azami M.F.A.; Samsudin M.A.I.; Othman E.S.
Published: (2024)

New Optimized Adaptive Time Series IDS Classifier Algorithm: Beyond Deep Learning
by: Muda S.R.B.T.; Yusof M.H.M.; Alfawaz K.M.; Balfaqih M.; Alzahrani A.
Published: (2023)

Software module clustering based on the fuzzy adaptive teaching learning based optimization algorithm
by: Zamli K.Z.; Din F.; Ramli N.; Ahmed B.S.
Published: (2019)

Review on anomalous gait behavior detection using machine learning algorithms
by: Razak H.A.; Saleh M.A.M.; Tahir N.M.
Published: (2020)

First-order three-point boundary value problems at resonance part III
by: Mohamed M.; Thompson B.; Jusoh M.S.
Published: (2012)

Predicting dengue transmission rates by comparing different machine learning models with vector indices and meteorological data
by: Ong S.Q.; Isawasan P.; Ngesom A.M.M.; Shahar H.; Lasim A.M.; Nair G.
Published: (2023)

A Survey on Topics Rating for the Undergraduate and Diploma in Environmental Health
by: Arshad K.; Lean Q.Y.; Ming L.C.; Mahalingam S.R.; Tiong C.S.; Abdullah A.H.; Shafie F.A.
Published: (2018)

Detection and Defense Algorithms of Different Types of DDoS Attacks Using Machine Learning
by: Yusof M.A.M.; Ali F.H.M.; Darus M.Y.
Published: (2018)

An evaluation of nature-inspired optimization algorithms and machine learning classifiers for electricity fraud prediction
by: Kamaruddin A.S.; Hadrawi M.F.; Wah Y.B.; Aliman S.
Published: (2023)

Pothole Sensing and Analysis with Doppler Audio Signal Spectrum Employing Machine Learning Algorithms
by: Zainuddin S.; Ismail M.A.D.; Nasir H.M.; Rashid N.E.A.; Shariff K.K.M.; Abidin I.Z.
Published: (2024)

Adaptive web-based learning framework
by: Khir N.H.B.M.; Ismail M.; Shamsudin N.A.B.
Published: (2012)

Survey on Formation Verification for Ensembling Collective Adaptive System
by: Johari M.H.; Jawaddi S.N.A.; Ismail A.
Published: (2022)

Urban building detection using object-based image analysis (OBIA) and machine learning (ML) algorithms
by: Norman M.; Shahar H.M.; Mohamad Z.; Rahim A.; Mohd F.A.; Shafri H.Z.M.
Published: (2021)

Adaptation of abbreviated mathematics anxiety rating scale for engineering students
by: Nordin S.K.S.; Samat K.F.; Sultan A.A.M.; Halim B.A.; Ismail S.F.; Mafazi N.W.
Published: (2015)

Affective change is the shadow of adaptive leadership in learning organisations
by: Chughtai M.S.; Syed F.; Khalid R.; Raza M.; Raza H.; Valeri M.
Published: (2024)

Evaluating Machine Learning Algorithms for Predicting Financial Aid Eligibility: A Comparative Study of Random Forest, Gradient Boosting and Neural Network
by: Ismail M.H.; Razak T.R.; Noor N.M.; Aziz A.A.
Published: (2024)

Machine learning algorithms for high-resolution prediction of spatiotemporal distribution of air pollution from meteorological and soil parameters
by: Tao H.; Jawad A.H.; Shather A.H.; Al-Khafaji Z.; Rashid T.A.; Ali M.; Al-Ansari N.; Marhoon H.A.; Shahid S.; Yaseen Z.M.
Published: (2023)

Assessing the Efficiency of Remote Sensing and Machine Learning Algorithms to Quantify Wheat Characteristics in the Nile Delta Region of Egypt
by: Elmetwalli A.H.; Mazrou Y.S.A.; Tyler A.N.; Hunter P.D.; Elsherbiny O.; Yaseen Z.M.; Elsayed S.
Published: (2022)

Escape the Desert Island: Blended Escape Rooms in the First-Semester Problem-Based Learning
by: Abdul Rahim A.S.
Published: (2023)

A review of mobile pervasive learning: Applications and issues
by: Shuib L.; Shamshirband S.; Ismail M.H.
Published: (2015)

Machine Learning in Safety and Health Research: A Scientometric Analysis
by: Abdullah K.H.; Sofyan D.
Published: (2023)

A Review of Wildfire Studies using Machine Learning Applications
by: Aziz N.F.A.; Ya’acob N.; Yusof A.L.; Kassim M.
Published: (2024)

A New Approach in Mitigating Adversarial Attacks on Machine Learning
by: Ahmad A.A.I.; Jalil K.A.
Published: (2024)

A stochastic model for relative risk estimation of leptospirosis in Malaysia
by: Ideris S.H.; Malim M.R.; Shaadan N.
Published: (2019)

AN EXPLORATORY SEQUENTIAL SENTIMENT ANALYSIS OF ONLINE LEARNING DURING THE MOVEMENT CONTROL ORDER IN MALAYSIA
by: Rahman N.A.; Zukarnain Z.A.; Zain N.A.M.; Yusof R.
Published: (2021)

Collaborative pedagogy for global learners: Adaptive teaching for borderless learning
by: Hamid M.Z.S.A.; Hashim K.S.; Barcelona K.E.P.; Babiera R.M., et al.
Published: (2023)