herolib/lib/core/texttools

TextTools Module

The TextTools module provides a comprehensive set of utilities for text manipulation and processing in V. It includes functions for cleaning, parsing, formatting, and transforming text in various ways.

Features

Array Operations

• to_array(r string) []string - Converts a comma or newline separated list to an array of strings
• to_array_int(r string) []int - Converts a text list to an array of integers
• to_map(mapstring string, line string, delimiter_ string) map[string]string - Intelligent mapping of a line to a map based on a template

Text Cleaning

• name_clean(r string) string - Normalizes names by removing special characters
• ascii_clean(r string) string - Removes all non-ASCII characters
• remove_empty_lines(text string) string - Removes empty lines from text
• remove_double_lines(text string) string - Removes consecutive empty lines
• remove_empty_js_blocks(text string) string - Removes empty code blocks (...)

Command Line Parsing

• cmd_line_args_parser(text string) ![]string - Parses command line arguments with support for quotes and escaping
• text_remove_quotes(text string) string - Removes quoted sections from text
• check_exists_outside_quotes(text string, items []string) bool - Checks if items exist in text outside of quotes

Text Expansion

• expand(txt_ string, l int, expand_with string) string - Expands text to a specified length with a given character

Indentation

• indent(text string, prefix string) string - Adds indentation prefix to each line
• dedent(text string) string - Removes common leading whitespace from every line

String Validation

• is_int(text string) bool - Checks if text contains only digits
• is_upper_text(text string) bool - Checks if text contains only uppercase letters

Multiline Processing

• multiline_to_single(text string) !string - Converts multiline text to a single line with proper escaping
• Handles comments, code blocks, and preserves formatting

Name/Path Processing

• name_fix(name string) string - Normalizes filenames and paths
• name_fix_keepspace(name string) !string - Like name_fix but preserves spaces
• name_fix_no_ext(name_ string) string - Removes file extension
• name_fix_snake_to_pascal(name string) string - Converts snake_case to PascalCase
• snake_case(name string) string - Converts PascalCase to snake_case
• name_split(name string) !(string, string) - Splits name into site and page components

Text Splitting

• split_smart(t string, delimiter_ string) []string - Intelligent string splitting that respects quotes

Tokenization

• tokenize(text_ string) TokenizerResult - Tokenizes text into meaningful parts
• text_token_replace(text string, tofind string, replacewith string) !string - Replaces tokens in text

Version Parsing

• version(text_ string) int - Converts version strings to comparable integers
  • Example: "v0.4.36" becomes 4036
  • Example: "v1.4.36" becomes 1004036

Usage Examples

Array Operations

// Convert comma-separated list to array
text := "item1,item2,item3"
array := texttools.to_array(text)
// Result: ['item1', 'item2', 'item3']

// Smart mapping
r := texttools.to_map("name,-,-,-,-,pid,-,-,-,-,path",
    "root   304   0.0  0.0 408185328   1360   ??  S    16Dec23   0:34.06 /usr/sbin/distnoted")
// Result: {'name': 'root', 'pid': '1360', 'path': '/usr/sbin/distnoted'}

Text Cleaning

// Clean name
name := texttools.name_clean("Hello@World!")
// Result: "HelloWorld"

// Remove empty lines
text := texttools.remove_empty_lines("line1\n\nline2\n\n\nline3")
// Result: "line1\nline2\nline3"

Command Line Parsing

// Parse command line with quotes
args := texttools.cmd_line_args_parser("'arg with spaces' --flag=value")
// Result: ['arg with spaces', '--flag=value']

Indentation

// Add indentation
text := texttools.indent("line1\nline2", "  ")
// Result: "  line1\n  line2\n"

// Remove common indentation
text := texttools.dedent("    line1\n    line2")
// Result: "line1\nline2"

Name Processing

// Convert to snake case
name := texttools.snake_case("HelloWorld")
// Result: "hello_world"

// Convert to pascal case
name := texttools.name_fix_snake_to_pascal("hello_world")
// Result: "HelloWorld"

Version Parsing

// Parse version string
ver := texttools.version("v0.4.36")
// Result: 4036

ver := texttools.version("v1.4.36")
// Result: 1004036