dict/stopper.h File Reference

#include "choicearr.h"
#include "states.h"

Go to the source code of this file.

Classes

• struct DANGERR

  Holds measure of 'dangerous ambiguity' ?? More...
  

Defines

• #define DisableChoiceAccum()   (KeepWordChoices = FALSE)
• #define EnableChoiceAccum()   (KeepWordChoices = TRUE)

Typedefs

• typedef UINT8 BLOB_WIDTH

  Type of UINT8, holds width of blob, in units of chunks.
  

Functions

• int AcceptableChoice (CHOICES_LIST Choices, A_CHOICE *BestChoice, A_CHOICE *RawChoice, DANGERR *fixpt)

  Return TRUE if the results from this segmentation are good enough to stop; else FALSE.
  

• int AcceptableResult (A_CHOICE *BestChoice, A_CHOICE *RawChoice)

  Return FALSE if the best choice for the current word is questionable and should be tried again on the second pass or should be flagged to the user.
  

• int AlternativeChoicesWorseThan (FLOAT32 Threshold)

  Returns TRUE if there are no alternative choices for the current word OR if all alternatives have an adjust factor worse than Threshold.
  

• FLOAT32 CurrentBestChoiceAdjustFactor ()

  Return the adjustment factor for the best choice for the current word.
  

• int CurrentBestChoiceIs (const char *Word)

  Returns TRUE if Word is the same as the current best choice, FALSE otherwise.
  

• int CurrentWordAmbig ()

  Returns TRUE if there are multiple good choices for the current word and FALSE otherwise.
  

• void DebugWordChoices ()

  Print the current choices for this word to stdout.
  

• void EndDangerousAmbigs ()
• void FilterWordChoices ()

  Removes from BestChoices all choices which are not within a reasonable range of the best choice.
  

• void FindClassifierErrors (FLOAT32 MinRating, FLOAT32 MaxRating, FLOAT32 RatingMargin, FLOAT32 Thresholds[])

  Compares the best choice for the current word to the best raw choice to determine which characters were classified incorrectly by the classifier; places a separate threshold into Thresholds for each character in the word.
  

• void InitChoiceAccum ()

  Initializes the data structures used to keep track the good word choices found for a word.
  

• void InitStopperVars ()

  Initializes the control variables used by the stopper.
  

• void LogNewRawChoice (A_CHOICE *Choice, FLOAT32 AdjustFactor, float Certainties[])

  Compares Choice to the best raw (non-dict) choice so far; if new choice is better, best raw choice is updated.
  

• void LogNewSegmentation (PIECES_STATE BlobWidth)

  Updates the blob widths in CurrentSegmentation to be the same as provided in BlobWidth.
  

• void LogNewSplit (int Blob)

  Adds one chunk to the specified blob for each choice in BestChoices and for the BestRawChoice.
  

• void LogNewWordChoice (A_CHOICE *Choice, FLOAT32 AdjustFactor, float Certainties[])

  Adds Choice to BestChoices if the adjusted certainty for Choice is within a reasonable range of the best choice in BestChoices.
  

• int NoDangerousAmbig (const char *Word, DANGERR *fixpt)
• void SettupStopperPass1 ()

  Performs any settup of stopper variables that is needed in preparation for the first pass.
  

• void SettupStopperPass2 ()

  Performs any settup of stopper variables that is needed in preparation for the second pass.
  

Variables

• float CertaintyPerChar
• BOOL8 KeepWordChoices
• float NonDictCertainty
• float RejectCertaintyOffset
• int StopperDebugLevel

---

Define Documentation

 

#define DisableChoiceAccum

(

)

(KeepWordChoices = FALSE)

Definition at line 76 of file stopper.h.

Referenced by permute_subword().

 

#define EnableChoiceAccum

(

)

(KeepWordChoices = TRUE)

Definition at line 77 of file stopper.h.

Referenced by InitChoiceAccum(), and permute_subword().

---

Typedef Documentation

BLOB_WIDTH

Type of UINT8, holds width of blob, in units of chunks.

Used as follows:

for (BlobWidth = CurrentSegmentation,
    End = CurrentSegmentation + MAX_NUM_CHUNKS;
    BlobWidth < End; *BlobWidth++ = 1)

Where CurrentSegmentation is of type PIECES_STATE and MAX_NUM_CHUNKS is 64 (dict/states.h)

Definition at line 41 of file stopper.h.

---

Function Documentation

int AcceptableChoice	(	CHOICES_LIST	Choices,
		A_CHOICE *	BestChoice,
		A_CHOICE *	RawChoice,
		DANGERR *	fixpt
	)

Return TRUE if the results from this segmentation are good enough to stop; else FALSE.

Parameters:

	Choices	Choices for current segmentation
	BestChoice	Best choice for current segmentation
	RawChoice	Best raw choice for current segmentation
	fixpt	point to fix

Note:

Globals:

• NonDictCertainty certainty for a non-dict word
• SmallWordSize size of word to be treated as non-word
• CertaintyPerChar certainty to add for each dict char

Returns:

TRUE or FALSE.

Note:

Exceptions: none

Date:

Mon Apr 29 14:57:32 1991, DSJ, Created.

Definition at line 226 of file stopper.cpp.

References case_ok(), CertaintyPerChar, class_certainty, class_string, cprintf(), FALSE, DANGERR::index, LengthOfShortestAlphaRun(), NoDangerousAmbig(), NonDictCertainty, NULL, punctuation_ok(), StopperDebugLevel, TRUE, UniformCertainties(), valid_number(), and valid_word().

Referenced by chop_word_main(), evaluate_state(), and improve_by_chopping().

                                     {
  float CertaintyThreshold = NonDictCertainty;
  int WordSize;

  if (fixpt != NULL)
    fixpt->index = -1;
  if ((BestChoice == NULL) || (class_string (BestChoice) == NULL))
    return (FALSE);

  if (StopperDebugLevel >= 1)
    cprintf ("\nStopper:  %s (word=%c, case=%c, punct=%c)\n",
      class_string (BestChoice),
      (valid_word (class_string (BestChoice)) ? 'y' : 'n'),
    (case_ok (class_string (BestChoice)) ? 'y' : 'n'),
    ((punctuation_ok (class_string (BestChoice)) !=
    -1) ? 'y' : 'n'));

  if (valid_word (class_string (BestChoice)) &&
    case_ok (class_string (BestChoice)) &&
  punctuation_ok (class_string (BestChoice)) != -1) {
    WordSize = LengthOfShortestAlphaRun (class_string (BestChoice));
    WordSize -= SmallWordSize;
    if (WordSize < 0)
      WordSize = 0;
    CertaintyThreshold += WordSize * CertaintyPerChar;
  }
  else if (stopper_numbers_on && valid_number (class_string (BestChoice))) {
    CertaintyThreshold += stopper_numbers_on * CertaintyPerChar;
  }

  if (StopperDebugLevel >= 1)
    cprintf ("Stopper:  Certainty = %4.1f, Threshold = %4.1f\n",
      class_certainty (BestChoice), CertaintyThreshold);

  if (NoDangerousAmbig (class_string (BestChoice), fixpt)
    && class_certainty (BestChoice) > CertaintyThreshold &&
    UniformCertainties (Choices, BestChoice))
    return (TRUE);
  else
    return (FALSE);

}                                /* AcceptableChoice */

int AcceptableResult	(	A_CHOICE *	BestChoice,
		A_CHOICE *	RawChoice
	)

Return FALSE if the best choice for the current word is questionable and should be tried again on the second pass or should be flagged to the user.

Parameters:

	BestChoice	Best choice for current word
	RawChoice	Best raw choice for current word

Note:

Globals:

• NonDictCertainty Certainty for a non-dict word
• SmallWordSize Size of word to be treated as non-word
• CertaintyPerChar Certainty to add for each dict char
• BestChoices List of all good choices found
• RejectOffset Allowed offset before a word is rejected
• StopperDebugLevel Debugging level

Returns:

TRUE or FALSE.

Note:

Exceptions: none

Date:

Thu May 9 14:05:05 1991, DSJ, Created.

Definition at line 292 of file stopper.cpp.

References BestChoices, case_ok(), CertaintyPerChar, class_certainty, class_string, cprintf(), CurrentWordAmbig(), FALSE, LengthOfShortestAlphaRun(), NIL, NonDictCertainty, NULL, punctuation_ok(), RejectOffset, rest, StopperDebugLevel, TRUE, and valid_word().

Referenced by tess_acceptable_word().

                                                                { 
  float CertaintyThreshold = NonDictCertainty - RejectOffset;
  int WordSize;

  if (StopperDebugLevel >= 1)
    cprintf ("\nRejecter: %s (word=%c, case=%c, punct=%c, unambig=%c)\n",
      class_string (BestChoice),
      (valid_word (class_string (BestChoice)) ? 'y' : 'n'),
    (case_ok (class_string (BestChoice)) ? 'y' : 'n'),
    ((punctuation_ok (class_string (BestChoice)) != -1) ? 'y' : 'n'),
    ((rest (BestChoices) != NIL) ? 'n' : 'y'));

  if ((BestChoice == NULL) ||
    (class_string (BestChoice) == NULL) || CurrentWordAmbig ())
    return (FALSE);

  if (valid_word (class_string (BestChoice)) &&
    case_ok (class_string (BestChoice)) &&
  punctuation_ok (class_string (BestChoice)) != -1) {
    WordSize = LengthOfShortestAlphaRun (class_string (BestChoice));
    WordSize -= SmallWordSize;
    if (WordSize < 0)
      WordSize = 0;
    CertaintyThreshold += WordSize * CertaintyPerChar;
  }

  if (StopperDebugLevel >= 1)
    cprintf ("Rejecter: Certainty = %4.1f, Threshold = %4.1f   ",
      class_certainty (BestChoice), CertaintyThreshold);

  if (class_certainty (BestChoice) > CertaintyThreshold) {
    if (StopperDebugLevel >= 1)
      cprintf ("ACCEPTED\n");
    return (TRUE);
  }
  else {
    if (StopperDebugLevel >= 1)
      cprintf ("REJECTED\n");
    return (FALSE);
  }
}                                /* AcceptableResult */

int AlternativeChoicesWorseThan

(

FLOAT32

Threshold

)

Returns TRUE if there are no alternative choices for the current word OR if all alternatives have an adjust factor worse than Threshold.

Parameters:

Threshold

Minimum adjust factor for alternative choices

Note:

Globals: BestChoices Alternative choices for current word

Returns:

TRUE or FALSE.

Note:

Exceptions: none

Date:

Mon Jun 3 09:36:31 1991, DSJ, Created.

Definition at line 347 of file stopper.cpp.

References VIABLE_CHOICE_STRUCT::AdjustFactor, BestChoices, FALSE, first, iterate, rest, and TRUE.

Referenced by AdaptableWord().

                                                   { 
  LIST Alternatives;
  VIABLE_CHOICE Choice;

  Alternatives = rest (BestChoices);
  iterate(Alternatives) {
    Choice = (VIABLE_CHOICE) first (Alternatives);
    if (Choice->AdjustFactor <= Threshold)
      return (FALSE);
  }

  return (TRUE);

}                                /* AlternativeChoicesWorseThan */

FLOAT32 CurrentBestChoiceAdjustFactor

(

)

Return the adjustment factor for the best choice for the current word.

Parameters:

none

Note:

Globals: BestChoices Set of best choices for current word

Returns:

Adjust factor for current best choice.

Note:

Exceptions: none

Date:

Thu May 30 14:48:24 1991, DSJ, Created.

Definition at line 392 of file stopper.cpp.

References VIABLE_CHOICE_STRUCT::AdjustFactor, BestChoices, first, MAX_FLOAT32, and NIL.

Referenced by AdaptableWord().

                                        { 
  VIABLE_CHOICE BestChoice;

  if (BestChoices == NIL)
    return (MAX_FLOAT32);

  BestChoice = (VIABLE_CHOICE) first (BestChoices);
  return (BestChoice->AdjustFactor);

}                                /* CurrentBestChoiceAdjustFactor */

int CurrentBestChoiceIs

(

const char *

Word

)

Returns TRUE if Word is the same as the current best choice, FALSE otherwise.

Parameters:

Word

String to compare to current best choice

Note:

Globals: BestChoices Set of best choices for current word

Returns:

TRUE or FALSE

Note:

Exceptions: none

Date:

Thu May 30 14:44:22 1991, DSJ, Created.

Definition at line 374 of file stopper.cpp.

References BestChoices, first, NIL, and StringSameAs().

Referenced by AdaptableWord().

                                          { 
  return (BestChoices != NIL &&
    StringSameAs (Word, (VIABLE_CHOICE) first (BestChoices)));

}                                /* CurrentBestChoiceIs */

int CurrentWordAmbig

(

)

Returns TRUE if there are multiple good choices for the current word and FALSE otherwise.

Parameters:

none

Note:

Globals: BestChoices Set of best choices for current word

Returns:

TRUE or FALSE

Note:

Exceptions: none

Date:

Wed May 22 15:38:38 1991, DSJ, Created.

Definition at line 415 of file stopper.cpp.

References BestChoices, NIL, and rest.

Referenced by AcceptableResult(), and add_document_word().

                       { 
  return (rest (BestChoices) != NIL);

}                                /* CurrentWordAmbig */

void DebugWordChoices

(

)

Print the current choices for this word to stdout.

Parameters:

none

Note:

Globals: BestRawChoice, BestChoices

Returns:

none

Note:

Exceptions: none

Date:

Wed May 15 13:52:08 1991, DSJ, Created.

Definition at line 431 of file stopper.cpp.

References BestChoices, BestRawChoice, cprintf(), first, iterate, PrintViableChoice(), StopperDebugLevel, StringSameAs(), and WordToDebug.

Referenced by cc_recog().

                        { 
  LIST Choices;
  int i;
  char LabelString[80];

  if (StopperDebugLevel >= 1 ||
    WordToDebug && BestChoices &&
  StringSameAs (WordToDebug, (VIABLE_CHOICE) first (BestChoices))) {
    if (BestRawChoice)
      PrintViableChoice (stdout, "\nBest Raw Choice:   ", BestRawChoice);

    i = 1;
    Choices = BestChoices;
    if (Choices)
      cprintf ("\nBest Cooked Choices:\n");
    iterate(Choices) {
      sprintf (LabelString, "Cooked Choice #%d:  ", i);
      PrintViableChoice (stdout, LabelString,
        (VIABLE_CHOICE) first (Choices));
      i++;
    }
  }
}                                /* DebugWordChoices */

void EndDangerousAmbigs

(

)

Definition at line 801 of file stopper.cpp.

References AmbigFor, destroy_nodes(), Efree(), MAX_CLASS_ID, and NULL.

Referenced by EndAdaptiveClassifier().

                          {
  if (AmbigFor != NULL) {
    for (int i = 0; i <= MAX_CLASS_ID; ++i) {
      destroy_nodes(AmbigFor[i], Efree);
    }
    Efree(AmbigFor);
    AmbigFor = NULL;
  }
}

void FilterWordChoices

(

)

Removes from BestChoices all choices which are not within a reasonable range of the best choice.

Parameters:

none

Note:

Globals: BestChoices Set of choices for current word

Returns:

none

Note:

Exceptions: none

Date:

Wed May 15 13:08:24 1991, DSJ, Created.

Definition at line 467 of file stopper.cpp.

References BestChoices, delete_d(), ExpandChoice(), first, FreeBadChoice(), NIL, rest, second, and set_rest.

Referenced by chop_word_main().

                         { 
  EXPANDED_CHOICE BestChoice;

  if (BestChoices == NIL || second (BestChoices) == NIL)
    return;

  /* compute certainties and class for each chunk in best choice */
  ExpandChoice ((VIABLE_CHOICE_STRUCT *) first (BestChoices), &BestChoice);

  set_rest (BestChoices, delete_d (rest (BestChoices),
    &BestChoice, FreeBadChoice));

}                                /* FilterWordChoices */

void FindClassifierErrors	(	FLOAT32	MinRating,
		FLOAT32	MaxRating,
		FLOAT32	RatingMargin,
		FLOAT32	Thresholds[]
	)

Compares the best choice for the current word to the best raw choice to determine which characters were classified incorrectly by the classifier; places a separate threshold into Thresholds for each character in the word.

Parameters:

	MinRating	Limits how tight to make a template
	MaxRating	Limits how loose to make a template
	RatingMargin	Amount of margin to put in template
	Thresholds[]	Place to put error thresholds

Note:

Globals: none

Returns:

none (results are placed in Thresholds)

If the classifier was correct, MaxRating is placed into Thresholds. If the classifier was incorrect, the avg. match rating (error percentage) of the classifier's incorrect choice minus some margin is placed into thresholds.

This can then be used by the caller to try to create a new template for the desired class that will classify the character with a rating better than the threshold value. The match rating placed into Thresholds is never allowed to be below MinRating in order to prevent trying to make overly tight templates.

Note:

Exceptions: none

Date:

Fri May 31 16:02:57 1991, DSJ, Created.

Definition at line 511 of file stopper.cpp.

References assert(), BestChoices, BestRawChoice, VIABLE_CHOICE_STRUCT::Blob, CertaintyScale, EXPANDED_CHOICE::ChunkCertainty, EXPANDED_CHOICE::ChunkClass, CHAR_CHOICE::Class, ExpandChoice(), first, VIABLE_CHOICE_STRUCT::Length, NIL, NULL, and CHAR_CHOICE::NumChunks.

Referenced by GetAdaptThresholds().

                                            {
  EXPANDED_CHOICE BestRaw;
  VIABLE_CHOICE Choice;
  int i, j, Chunk;
  FLOAT32 AvgRating;
  int NumErrorChunks;

  assert (BestChoices != NIL);
  assert (BestRawChoice != NULL);

  ExpandChoice(BestRawChoice, &BestRaw);
  Choice = (VIABLE_CHOICE) first (BestChoices);

  for (i = 0, Chunk = 0; i < Choice->Length; i++, Thresholds++) {
    AvgRating = 0.0;
    NumErrorChunks = 0;

    for (j = 0; j < Choice->Blob[i].NumChunks; j++, Chunk++)
    if (Choice->Blob[i].Class != BestRaw.ChunkClass[Chunk]) {
      AvgRating += BestRaw.ChunkCertainty[Chunk];
      NumErrorChunks++;
    }

    if (NumErrorChunks > 0) {
      AvgRating /= NumErrorChunks;
      *Thresholds = (AvgRating / -CertaintyScale) * (1.0 - RatingMargin);
    }
    else
      *Thresholds = MaxRating;

    if (*Thresholds > MaxRating)
      *Thresholds = MaxRating;
    if (*Thresholds < MinRating)
      *Thresholds = MinRating;
  }
}                                /* FindClassifierErrors */

void InitChoiceAccum

(

)

Initializes the data structures used to keep track the good word choices found for a word.

Parameters:

none

Note:

Globals: none

Returns:

none

Note:

Exceptions: none

Date:

Fri May 17 07:59:00 1991, DSJ, Created.

Definition at line 589 of file stopper.cpp.

References BestChoices, BestRawChoice, CurrentSegmentation, destroy_nodes(), EnableChoiceAccum, MAX_NUM_CHUNKS, memfree(), NIL, and NULL.

Referenced by cc_recog(), and program_editdown().

                       { 
  BLOB_WIDTH *BlobWidth, *End;

  if (BestRawChoice)
    memfree(BestRawChoice);

  if (BestChoices)
    destroy_nodes(BestChoices, memfree);

  BestRawChoice = NULL;
  BestChoices = NIL;
  EnableChoiceAccum();

  for (BlobWidth = CurrentSegmentation,
    End = CurrentSegmentation + MAX_NUM_CHUNKS;
    BlobWidth < End; *BlobWidth++ = 1);

}                                /* InitChoiceAccum */

void InitStopperVars

(

)

Initializes the control variables used by the stopper.

Parameters:

none

Note:

Globals: none

Returns:

none

Note:

Exceptions: none

Date:

Thu May 9 10:06:04 1991, DSJ, Created.

Definition at line 561 of file stopper.cpp.

References DANGEROUS_AMBIGS, DangerousAmbigs, dummy, string_variable, and WordToDebug.

Referenced by init_dj_debug().

                       { 
  VALUE dummy;

  string_variable (DangerousAmbigs, "DangerousAmbigs", DANGEROUS_AMBIGS);
  string_variable (WordToDebug, "WordToDebug", "");

  MakeNonDictCertainty();
  MakeRejectCertaintyOffset();
  MakeSmallWordSize();
  MakeCertaintyPerChar();
  MakeCertaintyVariation();
  MakeStopperDebugLevel();
  MakeAmbigThresholdGain();
  MakeAmbigThresholdOffset();
}                                /* InitStopperVars */

void LogNewRawChoice	(	A_CHOICE *	Choice,
		FLOAT32	AdjustFactor,
		float	Certainties[]
	)

Compares Choice to the best raw (non-dict) choice so far; if new choice is better, best raw choice is updated.

Parameters:

	Choice	New raw choice for current word
	AdjustFactor	Adjustment factor which was applied to choice
	Certainties	Certainties for each char in new choice

Note:

Globals: BestRawChoice Best raw choice so far for current word

Returns:

none

Note:

Exceptions: none

Date:

Wed May 15 09:57:19 1991, DSJ, Created.

Definition at line 623 of file stopper.cpp.

References BestRawChoice, ChoiceSameAs(), class_probability, KeepWordChoices, memfree(), NewViableChoice(), VIABLE_CHOICE_STRUCT::Rating, and ReplaceDuplicateChoice().

Referenced by permute_top_choice().

                                                                               {
  if (!KeepWordChoices)
    return;

  if (!BestRawChoice)
    BestRawChoice = NewViableChoice (Choice, AdjustFactor, Certainties);
  else if (class_probability (Choice) < BestRawChoice->Rating) {
    if (ChoiceSameAs (Choice, BestRawChoice))
      ReplaceDuplicateChoice(BestRawChoice, Choice, AdjustFactor, Certainties);
    else {
      memfree(BestRawChoice);
      BestRawChoice = NewViableChoice (Choice, AdjustFactor, Certainties);
    }
  }
}                                /* LogNewRawChoice */

void LogNewSegmentation

(

PIECES_STATE

BlobWidth

)

Updates the blob widths in CurrentSegmentation to be the same as provided in BlobWidth.

Parameters:

BlobWidth

number of chunks in each blob in segmentation

Note:

Globals: CurrentSegmentation blob widths for current segmentation

Returns:

none

Note:

Exceptions: none

Date:

Mon May 20 11:52:26 1991, DSJ, Created.

Definition at line 650 of file stopper.cpp.

References CurrentSegmentation.

Referenced by evaluate_state().

                                                { 
  BLOB_WIDTH *Segmentation;

  for (Segmentation = CurrentSegmentation; *BlobWidth != 0;
    BlobWidth++, Segmentation++)
  *Segmentation = *BlobWidth;
  *Segmentation = 0;

}                                /* LogNewSegmentation */

void LogNewSplit

(

int

Blob

)

Adds one chunk to the specified blob for each choice in BestChoices and for the BestRawChoice.

Parameters:

Blob

index of blob that was split

Note:

Globals:

• BestRawChoice current best raw choice
• BestChoices list of best choices found so far

Returns:

none

Note:

Exceptions: none

Date:

Mon May 20 11:38:56 1991, DSJ, Created.

Definition at line 674 of file stopper.cpp.

References AddNewChunk(), BestChoices, BestRawChoice, first, and iterate.

Referenced by improve_by_chopping().

                           { 
  LIST Choices;

  if (BestRawChoice) {
    AddNewChunk(BestRawChoice, Blob);
  }

  Choices = BestChoices;
  iterate(Choices) {
    AddNewChunk ((VIABLE_CHOICE) first (Choices), Blob);
  }

}                                /* LogNewSplit */

void LogNewWordChoice	(	A_CHOICE *	Choice,
		FLOAT32	AdjustFactor,
		float	Certainties[]
	)

Adds Choice to BestChoices if the adjusted certainty for Choice is within a reasonable range of the best choice in BestChoices.

Parameters:

	Choice	new choice for current word
	AdjustFactor	adjustment factor which was applied to choice
	Certainties	certainties for each char in new choice

Note:

Globals: BestChoices best choices so far for current word

Returns:

none

The BestChoices list is kept in sorted order by rating. Duplicates are removed.

Note:

Exceptions: none

Date:

Wed May 15 09:57:19 1991, DSJ, Created.

Definition at line 706 of file stopper.cpp.

References AmbigThreshold, BestCertainty, BestChoices, BestFactor, BestRating, ChoiceSameAs(), class_certainty, class_probability, CmpChoiceRatings(), count(), delete_d(), destroy_nodes(), Efree(), first, is_same_node(), iterate, KeepWordChoices, NewViableChoice(), NIL, nth_cell(), NULL, PrintViableChoice(), ReplaceDuplicateChoice(), rest, s_adjoin(), set_rest, and StopperDebugLevel.

Referenced by adjust_non_word(), adjust_number(), and adjust_word().

                                           {
  VIABLE_CHOICE NewChoice;
  LIST Choices;
  FLOAT32 Threshold;

  if (!KeepWordChoices)
    return;

  /* throw out obviously bad choices to save some work */
  if (BestChoices != NIL) {
    Threshold = AmbigThreshold (BestFactor (BestChoices), AdjustFactor);
    if (Threshold > -AmbigThresholdOffset)
      Threshold = -AmbigThresholdOffset;
    if (class_certainty (Choice) - BestCertainty (BestChoices) < Threshold)
      return;
  }

  /* see if a choice with the same text string has already been found */
  NewChoice = NULL;
  Choices = BestChoices;
  iterate(Choices) {
    if (ChoiceSameAs (Choice, (VIABLE_CHOICE) first (Choices)))
      if (class_probability (Choice) < BestRating (Choices))
        NewChoice = (VIABLE_CHOICE) first (Choices);
    else
      return;
  }

  if (NewChoice) {
    ReplaceDuplicateChoice(NewChoice, Choice, AdjustFactor, Certainties);
    BestChoices = delete_d (BestChoices, NewChoice, is_same_node);
  }
  else {
    NewChoice = NewViableChoice (Choice, AdjustFactor, Certainties);
  }

  BestChoices = s_adjoin (BestChoices, NewChoice, CmpChoiceRatings);
  if (StopperDebugLevel >= 2)
    PrintViableChoice (stdout, "New Word Choice:  ", NewChoice);
  if (count (BestChoices) > tessedit_truncate_wordchoice_log) {
    Choices =
      (LIST) nth_cell (BestChoices, tessedit_truncate_wordchoice_log);
    destroy_nodes (rest (Choices), Efree);
    set_rest(Choices, NIL);
  }

}                                /* LogNewWordChoice */

int NoDangerousAmbig	(	const char *	Word,
		DANGERR *	fixpt
	)

Definition at line 776 of file stopper.cpp.

References AmbigFor, AmbigsFound(), FALSE, FillAmbigTable(), DANGERR::index, MAX_WERD_SIZE, NULL, and TRUE.

Referenced by AcceptableChoice(), and word_adaptable().

                                                       {

  char NewWord[MAX_WERD_SIZE];
  char *NextNewChar;
  int bad_index = 0;

  if (!AmbigFor)
    AmbigFor = FillAmbigTable ();

  NextNewChar = NewWord;
  while (*Word)
  if (AmbigsFound (NewWord, NextNewChar, Word + 1, AmbigFor[*Word], fixpt)) {
    if (fixpt != NULL)
      fixpt->index = bad_index;
    return (FALSE);
  }
  else {
    *NextNewChar++ = *Word++;
    bad_index++;
  }

  return (TRUE);

}                                /* NoDangerousAmbig */

void SettupStopperPass1

(

)

Performs any settup of stopper variables that is needed in preparation for the first pass.

Parameters:

none

Note:

Globals: RejectOffset Offset allowed before word is rejected

Returns:

none

Note:

Exceptions: none

Date:

Mon Jun 3 12:32:00 1991, DSJ, Created.

Definition at line 822 of file stopper.cpp.

References RejectOffset.

Referenced by SettupPass1().

                          { 
  RejectOffset = 0.0;
}                                /* SettupStopperPass1 */

void SettupStopperPass2

(

)

Performs any settup of stopper variables that is needed in preparation for the second pass.

Parameters:

none

Note:

Globals: RejectOffset Offset allowed before word is rejected

Returns:

none

Note:

Exceptions: none

Date:

Mon Jun 3 12:32:00 1991, DSJ, Created.

Definition at line 838 of file stopper.cpp.

References RejectCertaintyOffset, and RejectOffset.

Referenced by SettupPass2().

                          { 
  RejectOffset = RejectCertaintyOffset;
}                                /* SettupStopperPass2 */

---

Variable Documentation

float CertaintyPerChar

Certainty to add for each dict char above SmallWordSize (2), defaults to -0.50

Referenced by AcceptableChoice(), AcceptableResult(), and set_tess_tweak_vars().

BOOL8 KeepWordChoices

flag used to disable accumulation of word choices during compound word permutation

Definition at line 159 of file stopper.cpp.

Referenced by LogNewRawChoice(), and LogNewWordChoice().

float NonDictCertainty

Certainty threshold for non-dict words, defaults to -2.50

Referenced by AcceptableChoice(), AcceptableResult(), set_tess_tweak_vars(), and UniformCertainties().

float RejectCertaintyOffset

Reject certainty offset, defaults to 1.0

Referenced by set_tess_tweak_vars(), and SettupStopperPass2().

int StopperDebugLevel

Stopper debug level, defaults to 0

Referenced by AcceptableChoice(), AcceptableResult(), AmbigsFound(), DebugWordChoices(), LogNewWordChoice(), and UniformCertainties().

---