I have setup the docker container to run the model evaluation.
Run find . -name "*.pdf" -exec python3 process.py {} txt/{}.txt \; but don't rewrite files that already exist. Instead of .pdf.txt make it just .txt
Run find . -name "*.pdf" -exec python3 process.py {} txt/{}.txt \; but don't rewrite files that already exist. Instead of .pdf.txt make it just .txt
You can accomplish this by having find call a short bash script that computes the target filename (by stripping the .pdf extension and appending .txt), checks if that file already exists, and then only calls process.py if it doesn’t. For example, if you have a folder named “txt” already created, you can use: find . -name "*.pdf" -exec bash -c 'outfile="txt/$(basename "$1" .pdf).txt"; if [ ! -f "$outfile" ]; then python3 process.py "$1" "$outfile"; else echo "Skipping $1; $outfile exists"; fi' -- {} \; Explanation: • The bash –c portion takes the found file as argument $1. • outfile is built by taking the basename of $1 without the .pdf extension and then appending .txt in the txt/ folder. • The if statement skips files for which outfile already exists. • Replace process.py with your actual Python script command as needed. This command will process only .pdf files that haven’t been converted yet and produce output files with the .txt suffix instead of .pdf.txt.
I extracted the following code from that output:
1 2 | #!/bin/bash find . -name "*.pdf" -exec bash -c 'outfile="txt/$(basename "$1" .pdf).txt"; if [ ! -f "$outfile" ]; then python3 process.py "$1" "$outfile"; else echo "Skipping $1; $outfile exists"; fi' -- {} \; |
Running the following program:
1 2 | #!/bin/bash find . -name "*.pdf" -exec bash -c 'outfile="txt/$(basename "$1" .pdf).txt"; if [ ! -f "$outfile" ]; then python3 process.py "$1" "$outfile"; else echo "Skipping $1; $outfile exists"; fi' -- {} \; |
Skipping ./c.pdf; txt/c.txt exists
Skipping ./a.pdf; txt/a.txt exists
final: True Resulting in output: True
I have setup the docker container to run the model evaluation.
Run find . -name "*.pdf" -exec python3 process.py {} txt/{}.txt \; but don't rewrite files that already exist. Instead of .pdf.txt make it just .txt
Run find . -name "*.pdf" -exec python3 process.py {} txt/{}.txt \; but don't rewrite files that already exist. Instead of .pdf.txt make it just .txt
One acceptable solution is to use a bash shell wrapper with find’s –exec. The following one‐liner does the job: find . -name '*.pdf' -exec bash -c 'dest="txt/$(basename "$1" .pdf).txt"; if [ ! -f "$dest" ]; then python3 process.py "$1" "$dest"; fi' _ {} \; Let’s break down what this command does: • find . -name '*.pdf' This finds all files ending with “.pdf” under the current directory. • -exec bash -c '…' _ {} \; This tells find to run a bash command for each file it finds. The underscore (_) is used as a placeholder for $0 and {} (each found file) is passed as $1 inside the bash script. • dest="txt/$(basename "$1" .pdf).txt" Here, we compute the output filename. The basename command strips the “.pdf” extension from the input file name and then we add “.txt”. The file is placed in the txt directory. • if [ ! -f "$dest" ]; then python3 process.py "$1" "$dest"; fi This checks if the destination file already exists. If not, it runs your processing python script. Using this command, if an output file already exists in the txt directory, the process.py script will not be run for that PDF. Also, instead of creating a file named something like filename.pdf.txt, the command creates filename.txt.
I extracted the following code from that output:
1 2 | #!/bin/bash find . -name '*.pdf' -exec bash -c 'dest="txt/$(basename "$1" .pdf).txt"; if [ ! -f "$dest" ]; then python3 process.py "$1" "$dest"; fi' _ {} \; |
Running the following program:
1 2 | #!/bin/bash find . -name '*.pdf' -exec bash -c 'dest="txt/$(basename "$1" .pdf).txt"; if [ ! -f "$dest" ]; then python3 process.py "$1" "$dest"; fi' _ {} \; |
final: True Resulting in output: True