Lines Matching full:samples

105  *  load samples from files listed in fileNamesTable into buffer.
106 * works even if buffer is too small to load all samples.
109 * @return : nb of samples effectively loaded into `buffer`
149 /* If file-chunking is enabled, load the rest of the file as more samples */ in DiB_loadFiles()
170 DISPLAYLEVEL(4, "Loaded %d KB total training data, %d nb samples \n", in DiB_loadFiles()
263 * provides the amount of data to be loaded and the resulting nb of samples.
304 …DISPLAYLEVEL(4, "Found training data %d files, %d KB, %d samples\n", nbFiles, (int)(fs.totalSizeTo… in DiB_fileStats()
315 int nbSamplesLoaded; /* nb of samples effectively loaded in srcBuffer */ in DiB_trainFromFiles()
316 size_t loadedSize; /* total data loaded in srcBuffer for all samples */ in DiB_trainFromFiles()
317 void* srcBuffer /* contiguous buffer with training data/samples */; in DiB_trainFromFiles()
326 The purpose of the shuffle is to pick random samples when the sample in DiB_trainFromFiles()
331 /* Figure out how much sample data to load with how many samples */ in DiB_trainFromFiles()
357 DISPLAYLEVEL(2, "! Note that dictionary is only useful for small samples. \n"); in DiB_trainFromFiles()
361 DISPLAYLEVEL(2, "! Warning : nb of samples too low for proper processing ! \n"); in DiB_trainFromFiles()
363 …(2, "! Alternatively, split files into fixed-size blocks representative of samples, with -B# \n"); in DiB_trainFromFiles()
364 EXM_THROW(14, "nb of samples too low"); /* we now clearly forbid this case */ in DiB_trainFromFiles()
367 … DISPLAYLEVEL(2, "! Warning : data size of samples too small for target dictionary size \n"); in DiB_trainFromFiles()
368 DISPLAYLEVEL(2, "! Samples should be about 100x larger than target dictionary size \n"); in DiB_trainFromFiles()
373 DISPLAYLEVEL(1, "Training samples set too large (%u MB); training on %u MB only...\n", in DiB_trainFromFiles()