Docker Setup

I have setup the docker container to run the model evaluation.

Initial Query

Run find . -name "*.pdf" -exec python3 process.py {} txt/{}.txt \; but don't rewrite files that already exist. Instead of .pdf.txt make it just .txt

LLM Generation

Query

Run find . -name "*.pdf" -exec python3 process.py {} txt/{}.txt \; but don't rewrite files that already exist. Instead of .pdf.txt make it just .txt

Output

You can achieve this by using the `-ok` option instead of `-exec`, which will prompt the user before executing the command. However, since you want to automate this process, you can use a bash script to check if the file exists before executing the command. Here's an example of how you can modify the command to achieve this: 

1
find . -name "*.pdf" -exec bash -c 'if [ ! -f "txt/{}.txt" ]; then python3 process.py {} txt/{}.txt; fi' \;
However, this command will not work as expected because `{}` is not expanded inside the bash command. A better approach is to use `-exec` with a bash script that checks if the file exists: 
1
find . -name "*.pdf" -exec bash -c 'f="{}"; txt_file="txt/${f%.pdf}.txt"; if [ ! -f "$txt_file" ]; then python3 process.py "$f" "$txt_file"; fi' \;
In this command: - `f="{}"` assigns the current file name to the variable `f`. - `txt_file="txt/${f%.pdf}.txt"` constructs the name of the corresponding `.txt` file by removing the `.pdf` extension and adding `.txt`. - `if [ ! -f "$txt_file" ]; then ...` checks if the `.txt` file exists. If it doesn't, the `python3` command is executed. This approach ensures that the `.txt` file is only generated if it doesn't already exist.

Extract Code

I extracted the following code from that output: 

1
2
3
#!/bin/bash

find . -name "*.pdf" -exec bash -c 'f="{}"; txt_file="txt/${f%.pdf}.txt"; if [ ! -f "$txt_file" ]; then python3 process.py "$f" "$txt_file"; fi' \;

Run Code Interpreter

Running the following program: 

1
2
3
#!/bin/bash

find . -name "*.pdf" -exec bash -c 'f="{}"; txt_file="txt/${f%.pdf}.txt"; if [ ! -f "$txt_file" ]; then python3 process.py "$f" "$txt_file"; fi' \;
And got the output:

PyFunc

final: True Resulting in output: True