StdVectorRandomizer< T > Class Template Reference

Randomizes elements of a vector according to a mask. More...

#include <nnet-randomizer.h>

Collaboration diagram for StdVectorRandomizer< T >:

Public Member Functions
	StdVectorRandomizer ()
	StdVectorRandomizer (const NnetDataRandomizerOptions &conf)
void	Init (const NnetDataRandomizerOptions &conf)
	Set the randomizer parameters (size) More...
void	AddData (const std::vector< T > &v)
	Add data to randomization buffer. More...
bool	IsFull ()
	Returns true, when capacity is full. More...
int32	NumFrames ()
	Number of frames stored inside the Randomizer. More...
void	Randomize (const std::vector< int32 > &mask)
	Randomize matrix row-order using mask. More...
bool	Done ()
	Returns true, if no more data for another mini-batch (after current one) More...
void	Next ()
	Sets cursor to next mini-batch. More...
const std::vector< T > &	Value ()
	Returns matrix-window with next mini-batch. More...

Private Attributes
std::vector< T >	data_
std::vector< T >	minibatch_
int32	data_begin_
	A cursor, pointing to the 'row' where the next mini-batch begins,. More...
int32	data_end_
	A cursor, pointing to the 'row' after the end of data,. More...
NnetDataRandomizerOptions	conf_

Detailed Description

template<typename T>
class kaldi::nnet1::StdVectorRandomizer< T >

Randomizes elements of a vector according to a mask.

Definition at line 209 of file nnet-randomizer.h.

Constructor & Destructor Documentation

StdVectorRandomizer() [1/2]

StdVectorRandomizer ( )

inline

Definition at line 211 of file nnet-randomizer.h.

                       :
    data_begin_(0),
    data_end_(0)
  { }

StdVectorRandomizer() [2/2]

StdVectorRandomizer ( const NnetDataRandomizerOptions &  conf )

inlineexplicit

Definition at line 216 of file nnet-randomizer.h.

                                                                     :
    data_begin_(0),
    data_end_(0)
  {
    Init(conf);
  }

Member Function Documentation

AddData()

void AddData

(

const std::vector< T > &

v

)

Add data to randomization buffer.

Definition at line 171 of file nnet-randomizer.cc.

References data_, and KALDI_ASSERT.

Referenced by main(), and UnitTestStdVectorRandomizer().

                                                          {
  // pre-allocate before 1st use
  if (data_.size() == 0) {
    data_.resize(conf_.randomizer_size);
  }
  // optionally put previous left-over to front
  if (data_begin_ > 0) {
    KALDI_ASSERT(data_begin_ <= data_end_);  // sanity check
    int32 leftover = data_end_ - data_begin_;
    KALDI_ASSERT(leftover < data_begin_);  // no overlap
    if (leftover > 0) {
      typename std::vector<T>::iterator leftover_begin = data_.begin() + data_begin_;
      std::copy(leftover_begin, leftover_begin + leftover, data_.begin());
    }
    data_begin_ = 0;
    data_end_ = leftover;
  }
  // extend the buffer if necessary
  if (data_.size() < data_end_ + v.size()) {
    data_.resize(data_end_ + v.size() + 1000);  // +1000 row surplus
  }
  // copy the data
  std::copy(v.begin(), v.end(), data_.begin()+data_end_);
  data_end_ += v.size();
}

Done()

bool Done ( )

inline

Returns true, if no more data for another mini-batch (after current one)

Definition at line 245 of file nnet-randomizer.h.

Referenced by UnitTestStdVectorRandomizer().

              {
    return (data_end_ - data_begin_ < conf_.minibatch_size);
  }

Init()

void Init ( const NnetDataRandomizerOptions &  conf )

inline

Set the randomizer parameters (size)

Definition at line 224 of file nnet-randomizer.h.

Referenced by UnitTestStdVectorRandomizer().

                                                   {
    conf_ = conf;
  }

IsFull()

bool IsFull ( )

inline

Returns true, when capacity is full.

Definition at line 232 of file nnet-randomizer.h.

Referenced by UnitTestStdVectorRandomizer().

                {
    return ((data_begin_ == 0) && (data_end_ > conf_.randomizer_size ));
  }

Next()

void Next

(

)

Sets cursor to next mini-batch.

Definition at line 211 of file nnet-randomizer.cc.

Referenced by main(), and UnitTestStdVectorRandomizer().

                                  {
  data_begin_ += conf_.minibatch_size;
}

NumFrames()

int32 NumFrames ( )

inline

Number of frames stored inside the Randomizer.

Definition at line 237 of file nnet-randomizer.h.

References kaldi::cu::Randomize().

Referenced by UnitTestStdVectorRandomizer().

                    {
    return data_end_;
  }

Randomize()

void Randomize

(

const std::vector< int32 > &

mask

)

Randomize matrix row-order using mask.

Definition at line 198 of file nnet-randomizer.cc.

References data_, rnnlm::i, and KALDI_ASSERT.

Referenced by main(), and UnitTestStdVectorRandomizer().

                                                                   {
  KALDI_ASSERT(data_begin_ == 0);
  KALDI_ASSERT(data_end_ > 0);
  KALDI_ASSERT(data_end_ == mask.size());
  // Use auxiliary buffer for unshuffled data
  std::vector<T> data_aux(data_);
  // randomize the data, mask is used to index elements in source vector
  for (int32 i = 0; i < mask.size(); i++) {
    data_.at(i) = data_aux.at(mask.at(i));
  }
}

Value()

const std::vector< T > & Value

(

)

Returns matrix-window with next mini-batch.

Definition at line 216 of file nnet-randomizer.cc.

References data_, and KALDI_ASSERT.

Referenced by main(), and UnitTestStdVectorRandomizer().

                                                  {
  // make sure we have enough data for minibatch,
  KALDI_ASSERT(data_end_ - data_begin_ >= conf_.minibatch_size);
  // prepare the mini-batch buffer,
  minibatch_.resize(conf_.minibatch_size);
  typename std::vector<T>::iterator first = data_.begin() + data_begin_;
  typename std::vector<T>::iterator last  = first + conf_.minibatch_size;
  std::copy(first, last, minibatch_.begin());
  return minibatch_;
}

Member Data Documentation

conf_

NnetDataRandomizerOptions conf_

private

Definition at line 264 of file nnet-randomizer.h.

data_

std::vector<T> data_

private

Definition at line 256 of file nnet-randomizer.h.

data_begin_

int32 data_begin_

private

A cursor, pointing to the 'row' where the next mini-batch begins,.

Definition at line 260 of file nnet-randomizer.h.

data_end_

int32 data_end_

private

A cursor, pointing to the 'row' after the end of data,.

Definition at line 262 of file nnet-randomizer.h.

minibatch_

std::vector<T> minibatch_

private

Definition at line 257 of file nnet-randomizer.h.

---

The documentation for this class was generated from the following files:

• nnet/nnet-randomizer.h
• nnet/nnet-randomizer.cc