First order vs Second order online machine learning algorithms

Question

In this git repo the online learning algorithms are classified as first order and second order. I tried searching what it means, yet I'm unable to understand the different between such first oder and second order online learning algorithms.

What is the difference between first order and second order online learning?

Study the canonical second order optimization algorithm: [Newton's method](https://en.wikipedia.org/wiki/Newton%27s_method_in_optimization). Welcome to the site. — Emre, Aug 16 '18 at 17:03

score 3 · Answer 1 · answered Jul 17 '18 at 16:29

3

First order and second order algorithms are algorithms which use respectively at least first derivative / second derivative.

This post explains well the definition.

answered Jul 17 '18 at 16:29

alexandre_d

418
4
12

First order vs Second order online machine learning algorithms

1 Answers1