All Classes Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Macros Modules Pages
RbmTrainOptions Struct Reference

#include <nnet-trnopts.h>

Collaboration diagram for RbmTrainOptions:

Public Member Functions

 RbmTrainOptions ()
 
void Register (OptionsItf *opts)
 

Public Attributes

BaseFloat learn_rate
 
BaseFloat momentum
 
BaseFloat momentum_max
 
int32 momentum_steps
 
int32 momentum_step_period
 
BaseFloat l2_penalty
 

Friends

std::ostream & operator<< (std::ostream &os, const RbmTrainOptions &opts)
 

Detailed Description

Definition at line 65 of file nnet-trnopts.h.

Constructor & Destructor Documentation

RbmTrainOptions ( )
inline

Definition at line 75 of file nnet-trnopts.h.

75  :
76  learn_rate(0.4),
77  momentum(0.5),
78  momentum_max(0.9),
79  momentum_steps(40),
80  momentum_step_period(500000),
81  // 500000 * 40 = 55h of linear increase of momentum
82  l2_penalty(0.0002)
83  { }

Member Function Documentation

void Register ( OptionsItf opts)
inline

Definition at line 86 of file nnet-trnopts.h.

References OptionsItf::Register().

Referenced by main().

86  {
87  opts->Register("learn-rate", &learn_rate, "Learning rate");
88 
89  opts->Register("momentum", &momentum,
90  "Initial momentum for linear scheduling");
91  opts->Register("momentum-max", &momentum_max,
92  "Final momentum for linear scheduling");
93  opts->Register("momentum-steps", &momentum_steps,
94  "Number of steps of linear momentum scheduling");
95  opts->Register("momentum-step-period", &momentum_step_period,
96  "Number of datapoints per single momentum increase step");
97 
98  opts->Register("l2-penalty", &l2_penalty,
99  "L2 penalty (weight decay, increases mixing-rate)");
100  }

Friends And Related Function Documentation

std::ostream& operator<< ( std::ostream &  os,
const RbmTrainOptions opts 
)
friend

Definition at line 103 of file nnet-trnopts.h.

103  {
104  os << "RbmTrainOptions : "
105  << "learn_rate" << opts.learn_rate << ", "
106  << "momentum" << opts.momentum << ", "
107  << "momentum_max" << opts.momentum_max << ", "
108  << "momentum_steps" << opts.momentum_steps << ", "
109  << "momentum_step_period" << opts.momentum_step_period << ", "
110  << "l2_penalty" << opts.l2_penalty;
111  return os;
112  }

Member Data Documentation

BaseFloat l2_penalty

Definition at line 72 of file nnet-trnopts.h.

Referenced by Rbm::RbmUpdate().

BaseFloat learn_rate

Definition at line 67 of file nnet-trnopts.h.

Referenced by main(), and Rbm::RbmUpdate().

BaseFloat momentum

Definition at line 68 of file nnet-trnopts.h.

Referenced by main(), and Rbm::RbmUpdate().

BaseFloat momentum_max

Definition at line 69 of file nnet-trnopts.h.

Referenced by main().

int32 momentum_step_period

Definition at line 71 of file nnet-trnopts.h.

Referenced by main().

int32 momentum_steps

Definition at line 70 of file nnet-trnopts.h.

Referenced by main().


The documentation for this struct was generated from the following file: