OnlineNnet2FeaturePipelineInfo Struct Reference

This class is responsible for storing configuration variables, objects and options for OnlineNnet2FeaturePipeline (including the actual LDA and CMVN-stats matrices, and the iVector extractor, which is a member of ivector_extractor_info. More...

#include <online-nnet2-feature-pipeline.h>

Collaboration diagram for OnlineNnet2FeaturePipelineInfo:

Public Member Functions
	OnlineNnet2FeaturePipelineInfo ()
	OnlineNnet2FeaturePipelineInfo (const OnlineNnet2FeaturePipelineConfig &config)
BaseFloat	FrameShiftInSeconds () const
int32	IvectorDim ()

Public Attributes
std::string	feature_type
MfccOptions	mfcc_opts
	"mfcc" or "plp" or "fbank" More...
PlpOptions	plp_opts
	options for MFCC computation, if feature_type == "mfcc" More...
FbankOptions	fbank_opts
	Options for PLP computation, if feature_type == "plp". More...
bool	add_pitch
	Options for filterbank computation, if feature_type == "fbank". More...
PitchExtractionOptions	pitch_opts
ProcessPitchOptions	pitch_process_opts
	Options for pitch extraction, if done. More...
bool	use_cmvn
	Options for pitch post-processing. More...
OnlineCmvnOptions	cmvn_opts
std::string	global_cmvn_stats_rxfilename
	Options for online cmvn, read from config file. More...
bool	use_ivectors
	Filename used for reading global cmvn stats in OnlineCmvn. More...
OnlineIvectorExtractionInfo	ivector_extractor_info
OnlineSilenceWeightingConfig	silence_weighting_config
	Config for weighting silence in iVector adaptation. More...

Private Member Functions
	KALDI_DISALLOW_COPY_AND_ASSIGN (OnlineNnet2FeaturePipelineInfo)

Detailed Description

This class is responsible for storing configuration variables, objects and options for OnlineNnet2FeaturePipeline (including the actual LDA and CMVN-stats matrices, and the iVector extractor, which is a member of ivector_extractor_info.

This class does not register options on the command line; instead, it is initialized from class OnlineNnet2FeaturePipelineConfig which reads the options from the command line. The reason for structuring it this way is to make it easier to configure from code as well as from the command line, as well as for easier multithreaded operation.

Definition at line 138 of file online-nnet2-feature-pipeline.h.

Constructor & Destructor Documentation

OnlineNnet2FeaturePipelineInfo() [1/2]

OnlineNnet2FeaturePipelineInfo ( )

inline

Definition at line 139 of file online-nnet2-feature-pipeline.h.

                                  :
      feature_type("mfcc"), add_pitch(false), use_cmvn(false) { }

OnlineNnet2FeaturePipelineInfo() [2/2]

OnlineNnet2FeaturePipelineInfo

(

const OnlineNnet2FeaturePipelineConfig &

config

)

Definition at line 25 of file online-nnet2-feature-pipeline.cc.

References OnlineNnet2FeaturePipelineConfig::add_pitch, OnlineNnet2FeaturePipelineInfo::add_pitch, OnlineNnet2FeaturePipelineConfig::cmvn_config, OnlineNnet2FeaturePipelineInfo::cmvn_opts, OnlineNnet2FeaturePipelineConfig::fbank_config, OnlineNnet2FeaturePipelineInfo::fbank_opts, OnlineNnet2FeaturePipelineConfig::feature_type, OnlineNnet2FeaturePipelineInfo::feature_type, OnlineNnet2FeaturePipelineConfig::global_cmvn_stats_rxfilename, OnlineNnet2FeaturePipelineInfo::global_cmvn_stats_rxfilename, OnlineIvectorExtractionInfo::Init(), OnlineNnet2FeaturePipelineConfig::ivector_extraction_config, OnlineNnet2FeaturePipelineInfo::ivector_extractor_info, KALDI_ERR, KALDI_WARN, OnlineNnet2FeaturePipelineConfig::mfcc_config, OnlineNnet2FeaturePipelineInfo::mfcc_opts, OnlineNnet2FeaturePipelineConfig::online_pitch_config, OnlineNnet2FeaturePipelineInfo::pitch_opts, OnlineNnet2FeaturePipelineInfo::pitch_process_opts, OnlineNnet2FeaturePipelineConfig::plp_config, OnlineNnet2FeaturePipelineInfo::plp_opts, kaldi::ReadConfigFromFile(), kaldi::ReadConfigsFromFile(), OnlineNnet2FeaturePipelineInfo::use_cmvn, and OnlineNnet2FeaturePipelineInfo::use_ivectors.

                                                   :
    silence_weighting_config(config.silence_weighting_config) {
  if (config.feature_type == "mfcc" || config.feature_type == "plp" ||
      config.feature_type == "fbank") {
    feature_type = config.feature_type;
  } else {
    KALDI_ERR << "Invalid feature type: " << config.feature_type << ". "
              << "Supported feature types: mfcc, plp, fbank.";
  }

  if (config.mfcc_config != "") {
    ReadConfigFromFile(config.mfcc_config, &mfcc_opts);
    if (feature_type != "mfcc")
      KALDI_WARN << "--mfcc-config option has no effect "
                 << "since feature type is set to " << feature_type << ".";
  }  // else use the defaults.

  if (config.plp_config != "") {
    ReadConfigFromFile(config.plp_config, &plp_opts);
    if (feature_type != "plp")
      KALDI_WARN << "--plp-config option has no effect "
                 << "since feature type is set to " << feature_type << ".";
  }  // else use the defaults.

  if (config.fbank_config != "") {
    ReadConfigFromFile(config.fbank_config, &fbank_opts);
    if (feature_type != "fbank")
      KALDI_WARN << "--fbank-config option has no effect "
                 << "since feature type is set to " << feature_type << ".";
  }  // else use the defaults.

  add_pitch = config.add_pitch;

  if (config.online_pitch_config != "") {
    ReadConfigsFromFile(config.online_pitch_config,
                        &pitch_opts,
                        &pitch_process_opts);
    if (!add_pitch)
      KALDI_WARN << "--online-pitch-config option has no effect "
                 << "since you did not supply --add-pitch option.";
  }  // else use the defaults.

  use_cmvn = (config.cmvn_config != "");
  if (use_cmvn) {
    ReadConfigFromFile(config.cmvn_config, &cmvn_opts);
    global_cmvn_stats_rxfilename = config.global_cmvn_stats_rxfilename;
    if (global_cmvn_stats_rxfilename == "")
      KALDI_ERR << "--global-cmvn-stats option is required "
                << " when --cmvn-config is specified.";
  }

  if (config.ivector_extraction_config != "") {
    use_ivectors = true;
    OnlineIvectorExtractionConfig ivector_extraction_opts;
    ReadConfigFromFile(config.ivector_extraction_config,
                       &ivector_extraction_opts);
    ivector_extractor_info.Init(ivector_extraction_opts);
  } else {
    use_ivectors = false;
  }
}

Member Function Documentation

FrameShiftInSeconds()

BaseFloat FrameShiftInSeconds

(

)

const

Definition at line 231 of file online-nnet2-feature-pipeline.cc.

References KALDI_ERR.

Referenced by main().

                                                                    {
  if (feature_type == "mfcc") {
    return mfcc_opts.frame_opts.frame_shift_ms / 1000.0f;
  } else if (feature_type == "fbank") {
    return fbank_opts.frame_opts.frame_shift_ms / 1000.0f;
  } else if (feature_type == "plp") {
    return plp_opts.frame_opts.frame_shift_ms / 1000.0f;
  } else {
    KALDI_ERR << "Unknown feature type " << feature_type;
    return 0.0;
  }
}

IvectorDim()

int32 IvectorDim ( )

inline

Definition at line 179 of file online-nnet2-feature-pipeline.h.

References OnlineIvectorExtractionInfo::extractor, IvectorExtractor::IvectorDim(), and KALDI_DISALLOW_COPY_AND_ASSIGN.

Referenced by main().

{ return ivector_extractor_info.extractor.IvectorDim(); }

KALDI_DISALLOW_COPY_AND_ASSIGN()

KALDI_DISALLOW_COPY_AND_ASSIGN ( OnlineNnet2FeaturePipelineInfo  )

private

Member Data Documentation

add_pitch

bool add_pitch

Options for filterbank computation, if feature_type == "fbank".

Definition at line 155 of file online-nnet2-feature-pipeline.h.

Referenced by OnlineNnet2FeaturePipeline::OnlineNnet2FeaturePipeline(), and OnlineNnet2FeaturePipelineInfo::OnlineNnet2FeaturePipelineInfo().

cmvn_opts

OnlineCmvnOptions cmvn_opts

Definition at line 162 of file online-nnet2-feature-pipeline.h.

Referenced by OnlineNnet2FeaturePipeline::OnlineNnet2FeaturePipeline(), and OnlineNnet2FeaturePipelineInfo::OnlineNnet2FeaturePipelineInfo().

fbank_opts

FbankOptions fbank_opts

Options for PLP computation, if feature_type == "plp".

Definition at line 152 of file online-nnet2-feature-pipeline.h.

Referenced by OnlineNnet2FeaturePipeline::OnlineNnet2FeaturePipeline(), and OnlineNnet2FeaturePipelineInfo::OnlineNnet2FeaturePipelineInfo().

feature_type

std::string feature_type

Definition at line 147 of file online-nnet2-feature-pipeline.h.

Referenced by OnlineNnet2FeaturePipeline::OnlineNnet2FeaturePipeline(), and OnlineNnet2FeaturePipelineInfo::OnlineNnet2FeaturePipelineInfo().

global_cmvn_stats_rxfilename

std::string global_cmvn_stats_rxfilename

Options for online cmvn, read from config file.

Definition at line 163 of file online-nnet2-feature-pipeline.h.

Referenced by main(), OnlineNnet2FeaturePipeline::OnlineNnet2FeaturePipeline(), and OnlineNnet2FeaturePipelineInfo::OnlineNnet2FeaturePipelineInfo().

ivector_extractor_info

OnlineIvectorExtractionInfo ivector_extractor_info

Definition at line 170 of file online-nnet2-feature-pipeline.h.

Referenced by main(), OnlineNnet2FeaturePipeline::OnlineNnet2FeaturePipeline(), and OnlineNnet2FeaturePipelineInfo::OnlineNnet2FeaturePipelineInfo().

mfcc_opts

MfccOptions mfcc_opts

"mfcc" or "plp" or "fbank"

Definition at line 149 of file online-nnet2-feature-pipeline.h.

Referenced by OnlineNnet2FeaturePipeline::OnlineNnet2FeaturePipeline(), and OnlineNnet2FeaturePipelineInfo::OnlineNnet2FeaturePipelineInfo().

pitch_opts

PitchExtractionOptions pitch_opts

Definition at line 156 of file online-nnet2-feature-pipeline.h.

Referenced by OnlineNnet2FeaturePipeline::OnlineNnet2FeaturePipeline(), and OnlineNnet2FeaturePipelineInfo::OnlineNnet2FeaturePipelineInfo().

pitch_process_opts

ProcessPitchOptions pitch_process_opts

Options for pitch extraction, if done.

Definition at line 157 of file online-nnet2-feature-pipeline.h.

Referenced by OnlineNnet2FeaturePipeline::OnlineNnet2FeaturePipeline(), and OnlineNnet2FeaturePipelineInfo::OnlineNnet2FeaturePipelineInfo().

plp_opts

PlpOptions plp_opts

options for MFCC computation, if feature_type == "mfcc"

Definition at line 151 of file online-nnet2-feature-pipeline.h.

Referenced by OnlineNnet2FeaturePipeline::OnlineNnet2FeaturePipeline(), and OnlineNnet2FeaturePipelineInfo::OnlineNnet2FeaturePipelineInfo().

silence_weighting_config

OnlineSilenceWeightingConfig silence_weighting_config

Config for weighting silence in iVector adaptation.

We declare this outside of ivector_extractor_info... it was just easier to set up the code that way; and also we think it's the kind of thing you might want to play with directly on the command line instead of inside sub-config-files.

Definition at line 177 of file online-nnet2-feature-pipeline.h.

Referenced by main().

use_cmvn

bool use_cmvn

Options for pitch post-processing.

If the user specified –cmvn-config, we set 'use_cmvn' to true, and the OnlineCmvn is added to the feature preparation pipeline.

Definition at line 161 of file online-nnet2-feature-pipeline.h.

Referenced by OnlineNnet2FeaturePipeline::OnlineNnet2FeaturePipeline(), and OnlineNnet2FeaturePipelineInfo::OnlineNnet2FeaturePipelineInfo().

use_ivectors

bool use_ivectors

Filename used for reading global cmvn stats in OnlineCmvn.

If the user specified –ivector-extraction-config, we assume we're using iVectors as an extra input to the neural net. Actually, we don't anticipate running this setup without iVectors.

Definition at line 169 of file online-nnet2-feature-pipeline.h.

Referenced by OnlineNnet2FeaturePipeline::GetAdaptationState(), OnlineNnet2FeaturePipeline::OnlineNnet2FeaturePipeline(), OnlineNnet2FeaturePipelineInfo::OnlineNnet2FeaturePipelineInfo(), and OnlineNnet2FeaturePipeline::SetAdaptationState().

---

The documentation for this struct was generated from the following files:

• online2/online-nnet2-feature-pipeline.h
• online2/online-nnet2-feature-pipeline.cc