Michael R. Bock @michaelrbock.com · Jul 23 1 / 2
4/ TaxCalcBench is a dataset of 51 pairs of user inputs and the expected tax return output + a testing harness. We made the task easy for the models. We provide: - all of the data (e.g. W-2s) needed to file a return - the expected output in IRS XML format
0 likes 1 replies
?
Replies
5/ Takeaway: models can’t calculate tax returns reliably today. Even on this simplified data set and allowing the models to output to a simplified format, the best model only calculates 32.35% of returns correctly.