RbmTrainOptions Struct Reference

#include <nnet-trnopts.h>

Collaboration diagram for RbmTrainOptions:

Public Member Functions
	RbmTrainOptions ()
void	Register (OptionsItf *opts)

Public Attributes
BaseFloat	learn_rate
BaseFloat	momentum
BaseFloat	momentum_max
int32	momentum_steps
int32	momentum_step_period
BaseFloat	l2_penalty

Friends
std::ostream &	operator<< (std::ostream &os, const RbmTrainOptions &opts)

Detailed Description

Definition at line 65 of file nnet-trnopts.h.

Constructor & Destructor Documentation

RbmTrainOptions()

RbmTrainOptions ( )

inline

Definition at line 75 of file nnet-trnopts.h.

                   :
    learn_rate(0.4),
    momentum(0.5),
    momentum_max(0.9),
    momentum_steps(40),
    momentum_step_period(500000),
    // 500000 * 40 = 55h of linear increase of momentum
    l2_penalty(0.0002)
  { }

Member Function Documentation

Register()

void Register ( OptionsItf *  opts )

inline

Definition at line 86 of file nnet-trnopts.h.

References OptionsItf::Register().

Referenced by main().

                                  {
    opts->Register("learn-rate", &learn_rate, "Learning rate");

    opts->Register("momentum", &momentum,
                   "Initial momentum for linear scheduling");
    opts->Register("momentum-max", &momentum_max,
                   "Final momentum for linear scheduling");
    opts->Register("momentum-steps", &momentum_steps,
                   "Number of steps of linear momentum scheduling");
    opts->Register("momentum-step-period", &momentum_step_period,
                   "Number of datapoints per single momentum increase step");

    opts->Register("l2-penalty", &l2_penalty,
                   "L2 penalty (weight decay, increases mixing-rate)");
  }

Friends And Related Function Documentation

operator<<

std::ostream& operator<< ( std::ostream &  os, const RbmTrainOptions &  opts  )

friend

Definition at line 103 of file nnet-trnopts.h.

                                                                             {
    os << "RbmTrainOptions : "
       << "learn_rate" << opts.learn_rate << ", "
       << "momentum" << opts.momentum << ", "
       << "momentum_max" << opts.momentum_max << ", "
       << "momentum_steps" << opts.momentum_steps << ", "
       << "momentum_step_period" << opts.momentum_step_period << ", "
       << "l2_penalty" << opts.l2_penalty;
    return os;
  }

Member Data Documentation

l2_penalty

BaseFloat l2_penalty

Definition at line 72 of file nnet-trnopts.h.

Referenced by Rbm::RbmUpdate().

learn_rate

BaseFloat learn_rate

Definition at line 67 of file nnet-trnopts.h.

Referenced by main(), and Rbm::RbmUpdate().

momentum

BaseFloat momentum

Definition at line 68 of file nnet-trnopts.h.

Referenced by main(), and Rbm::RbmUpdate().

momentum_max

BaseFloat momentum_max

Definition at line 69 of file nnet-trnopts.h.

Referenced by main().

momentum_step_period

int32 momentum_step_period

Definition at line 71 of file nnet-trnopts.h.

Referenced by main().

momentum_steps

int32 momentum_steps

Definition at line 70 of file nnet-trnopts.h.

Referenced by main().

---

The documentation for this struct was generated from the following file:

• nnet/nnet-trnopts.h