Resources Recordkeeping for Tax Purposes Guide (pdf) Small Business Recordkeeping Publication 583, Starting a Business and Keeping Records Basic records are documents that everybody should keep. Although the Internal Revenue Service (IRS) doesn’t require you to keep your records in