OLAVA (OCR + LLaVA)

1. Extract text and tables from images.

python ocr.py

python eval_llava.py

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
.idea		.idea
data_preprocessors		data_preprocessors
docs		docs
download_scripts		download_scripts
lib/MMMU		lib/MMMU
scripts		scripts
LICENSE		LICENSE
README.md		README.md
alien_ds.ipynb		alien_ds.ipynb
build_answer_dict_val.py		build_answer_dict_val.py
build_answer_dict_val_w_question.py		build_answer_dict_val_w_question.py
build_train_data.py		build_train_data.py
copy_test_files.py		copy_test_files.py
doc.md		doc.md
doc.pdf		doc.pdf
download.sh		download.sh
download_process_merge.sh		download_process_merge.sh
dummy.csv		dummy.csv
eval_llava.py		eval_llava.py
eval_only.py		eval_only.py
eval_only_mixtral.py		eval_only_mixtral.py
instructdoc_instructions.xlsx		instructdoc_instructions.xlsx
llava1.5_13b_test.json		llava1.5_13b_test.json
merge_data.sh		merge_data.sh
merge_datasets.py		merge_datasets.py
ocr.py		ocr.py
process_data.sh		process_data.sh
process_data_for_mixtral_eval.sh		process_data_for_mixtral_eval.sh
requirements.txt		requirements.txt
results.csv		results.csv
runme_llava_mix_train.py		runme_llava_mix_train.py
runme_llava_train.py		runme_llava_train.py
steps_for_datasets.txt		steps_for_datasets.txt
to_csv.py		to_csv.py