herolib/aiprompts/herolib_core/core_text.md

TextTools Module

The texttools module provides a comprehensive set of utilities for text manipulation and processing.

Functions and Examples

import incubaid.herolib.core.texttools

assert hello_world == texttools.name_fix("Hello World!")

Name/Path Processing

• name_fix(name string) string: Normalizes filenames and paths.

• name_fix_keepspace(name string) !string: Like name_fix but preserves spaces.

• name_fix_no_ext(name_ string) string: Removes file extension.

• name_fix_snake_to_pascal(name string) string: Converts snake_case to PascalCase.

  name := texttools.name_fix_snake_to_pascal("hello_world") // Result: "HelloWorld"
  

• snake_case(name string) string: Converts PascalCase to snake_case.

  name := texttools.snake_case("HelloWorld") // Result: "hello_world"
  

• name_split(name string) !(string, string): Splits name into site and page components.

Text Cleaning

• name_clean(r string) string: Normalizes names by removing special characters.

  name := texttools.name_clean("Hello@World!") // Result: "HelloWorld"
  

• ascii_clean(r string) string: Removes all non-ASCII characters.

• remove_empty_lines(text string) string: Removes empty lines from text.

  text := texttools.remove_empty_lines("line1\n\nline2\n\n\nline3") // Result: "line1\nline2\nline3"
  

• remove_double_lines(text string) string: Removes consecutive empty lines.

• remove_empty_js_blocks(text string) string: Removes empty code blocks (...).

Command Line Parsing

• cmd_line_args_parser(text string) ![]string: Parses command line arguments with support for quotes and escaping.

  args := texttools.cmd_line_args_parser("'arg with spaces' --flag=value") // Result: ['arg with spaces', '--flag=value']
  

• text_remove_quotes(text string) string: Removes quoted sections from text.

• check_exists_outside_quotes(text string, items []string) bool: Checks if items exist in text outside of quotes.

Text Expansion

• expand(txt_ string, l int, expand_with string) string: Expands text to a specified length with a given character.

Indentation

• indent(text string, prefix string) string: Adds indentation prefix to each line.

  text := texttools.indent("line1\nline2", "  ") // Result: "  line1\n  line2\n"
  

• dedent(text string) string: Removes common leading whitespace from every line.

  text := texttools.dedent("    line1\n    line2") // Result: "line1\nline2"
  

String Validation

• is_int(text string) bool: Checks if text contains only digits.
• is_upper_text(text string) bool: Checks if text contains only uppercase letters.

Multiline Processing

• multiline_to_single(text string) !string: Converts multiline text to a single line with proper escaping.

Text Splitting

• split_smart(t string, delimiter_ string) []string: Intelligent string splitting that respects quotes.

Tokenization

• tokenize(text_ string) TokenizerResult: Tokenizes text into meaningful parts.
• text_token_replace(text string, tofind string, replacewith string) !string: Replaces tokens in text.

Version Parsing

• version(text_ string) int: Converts version strings to comparable integers.

  ver := texttools.version("v0.4.36") // Result: 4036
  ver = texttools.version("v1.4.36") // Result: 1004036
  

Formatting

• format_rfc1123(t time.Time) string: Formats a time.Time object into RFC 1123 format.

Array Operations

• to_array(r string) []string: Converts a comma or newline separated list to an array of strings.

  text := "item1,item2,item3"
  array := texttools.to_array(text) // Result: ['item1', 'item2', 'item3']
  

• to_array_int(r string) []int: Converts a text list to an array of integers.

• to_map(mapstring string, line string, delimiter_ string) map[string]string: Intelligent mapping of a line to a map based on a template.

  r := texttools.to_map("name,-,-,-,-,pid,-,-,-,-,path",
      "root   304   0.0  0.0 408185328   1360   ??  S    16Dec23   0:34.06 /usr/sbin/distnoted")
  // Result: {'name': 'root', 'pid': '1360', 'path': '/usr/sbin/distnoted'}