Home

Useful Text Processing Commands

Details

Category: Generalia

Published: 21 January 2019

Create a symbolic link on windows:

Navigate to the directory in command prompt running in administrator mode, run this command:

mklink /D htdocs E:\htdocs

Move large amount of files (.txt files in example below) to a new folder (ubuntu):

find originalFolderName -name '*.txt' -exec mv {} targetFolderName/ \;

 

Bash Script for batch OCR using Tesseract where the output file starts with the name "hindi-xxx.png" and outputs each of the file with "text-" prefixed to it:

_________

#!/bin/sh

for i in hindi-*.png; do tesseract "$i" "text-$i" -l hin; done;

__________

 

Combile multiple text files with file name as the header /section on top. (Ubuntu)
tail -n +1 *.txt > combined.txt

 

Randomize the line numbers in a text file:
python -c "import random, sys; lines = open(sys.argv[1]).readlines(); random.shuffle(lines); print ''.join(lines)," D:\folder\test.txt > D:\Folder2\test_rand.txt


________
Count Unique lines in a large file (works on Ubuntu):
sort input.txt | uniq -c > output.txt

Read more: Useful Text Processing Commands