physbo.opt package

Module contents

class physbo.opt.Adam(params, grad, options={})

Bases: object

Optimizer of f(x) with the adam method

params

current input, x

Type:

numpy.ndarray

nparams

dimension

Type:

int

grad

gradient function, g(x) = f’(x)

Type:

function

m

Type:

numpy.ndarray

v

Type:

numpy.ndarray

epoch

the number of update already done

Type:

int

max_epoch

the maximum number of update

Type:

int

alpha

Type:

float

beta

Type:

float

gamma

Type:

float

epsilon

Type:

float

Parameters:

• params

• grad

• options (dict) –

  Hyperparameters for the adam method

  • ”alpha” (default: 0.001)

  • ”beta” (default: 0.9)

  • ”gamma” (default: 0.9999)

  • ”epsilon” (default: 1e-8)

  • ”max_epoch” (default: 4000)

run(*args, **kwargs)

set_params(params)

update(params, *args, **kwargs)

calculates the updates of params

Parameters:

• params (numpy.ndarray) – input

• args – will be passed to self.grad

• kwargs – will be passed to self.grad

Returns:

update of params

Return type:

numpy.ndarray