Processing Large Files

Available with Business Analyst license.

If you are processing a large data set, say over one million records, here are some suggestions to increase your processing speed:

• Sort the file by ZIP Code (or city and state) and uncheck the processing option in Address Coder to sort the file.
• Consider processing the file in sections. Create several projects that will process records with ZIP Codes < 35000, 35001 to 75000 and > 75000, or something similar. Then use the aggregation feature on the batch processing screen to create overall reports.
• Remove nonessential data from the file. Address Coder needs just address, city, state, and ZIP Code. Having tens or hundreds of other data fields will slow processing, especially if you are doing data appending. Use an ID field to merge your datasets after processing.

Note:

Certain file types have limitations beyond that Address Coder can't control. Excel files can't contain more than 65,532 records. Access, dBASE, and shapefile files cannot exceed 2 GB in total size.