Removing duplicate records

You can use the summarizing operation to remove duplicate records from an ACL table and save the remaining unique records in a new ACL table.

To remove duplicate records:

  1. Select Analyze > Summarize.
  2. On the Main tab, do one of the following:
    • Select the field that may contain duplicate values from the Summarize On list.

    • Click Summarize On to select the field, or to create an expression.

      The order in which you select the fields is the order in which the columns appear in the results. If you are appending results to an existing ACL table, the column selection and order must be identical to the column selection and order in the existing table.

  3. Do not select any Subtotal Fields.
  4. Click Other Fields.
  5. Click Add All.
    Note

    You must select Add All in Other Fields to ensure that you detect and remove only perfect duplicate records. For example, if you are searching for duplicate employee records and add only last name to Other Fields, you risk discarding records of multiple employees who have the same last name, even though each record is unique.

  6. If the field that may contain duplicate values is already sorted, you can optionally deselect Presort. If the data in the field is not sorted, you must leave Presort selected to ensure valid results.
  7. If there are records in the current view that you want to exclude from processing, enter a condition in the If text box, or click If to create an IF statement using the Expression Builder.

    The IF statement considers all records in the view and filters out those that do not meet the specified condition.

  8. Click the Output tab.
  9. In the To panel, select File.
  10. Specify the following information in the As panel:
    • File TypeACL Table is the only option. Saves the results to a new ACL table, or appends the results to an existing ACL table.

    • Name – Enter a table name in the Name text box. Or click Name and enter the table name, or select an existing table in the Save or Save File As dialog box to overwrite or append to the table. If ACL prefills a table name, you can accept the prefilled name, or change it.

      You can also specify an absolute or relative file path, or navigate to a different folder, to save or append the table in a location other than the project location. For example: C:\Results\No_duplicates.fil or Results\No_duplicates.fil.

    • Local – Only enabled when connected to a server table. Select Local to save the output table to the same location as the project, or to specify a path or navigate to a different local folder. Leave Local deselected to save the output table to the Prefix folder on the ACL server.

      Note

      For output results produced from analysis or processing of ACL Analytics Exchange server tables, select Local. You cannot use the Local setting to import results tables to ACL Analytics Exchange Server.

  11. Click the More tab.
  12. Select the appropriate option in the Scope panel.
    • All – This option is selected by default. Leave it selected to specify that all records in the view will be processed.

    • First – Select this option and enter a number in the text box to start processing at the first record in the view and include only the specified number of records.

    • Next – Select this option and enter a number in the text box to start processing at the currently selected record in the view and include only the specified number of records. The actual record number in the leftmost column must be selected, not data in the row.

    • While – Select this option to use a WHILE statement to limit the processing of records in the view based on a particular criterion or set of criteria. You can enter a condition in the While text box, or click While to create a WHILE statement using the Expression Builder.

      A WHILE statement allows records in the view to be processed only while the specified condition evaluates to true. As soon as the condition evaluates to false, the processing terminates, and no further records are considered. You can use the While option in conjunction with the All, First, or Next options.

    Note

    The number of records specified in the First or Next options references either the physical or the indexed order of records in a table, and disregards any filtering or quick sorting applied to the view. However, results of analytical operations respect any filtering.

    If a view is quick sorted, Next behaves like First.

  13. Select or deselect Use Output Table depending on whether or not you want the ACL table containing the output results to open automatically upon completion of the operation.
  14. If you want to append the output results to the end of an existing ACL table, do one of the following:
    • Select Append To Existing File if you are certain the output results and the existing table are identical in structure.

    • Leave Append To Existing File deselected if you want ACL to compare the record lengths of the output results and the existing table. If the record lengths are not identical, the data structure is not identical.

    Note

    Leaving Append To Existing File deselected is recommended if you are uncertain about the data structure. For more information about appending and data structure, see Appending results to ACL tables and text files.

  15. Click OK.
  16. If the overwrite prompt appears, select the appropriate option.

    If you are expecting the Append option to appear and it does not, click No to cancel the operation and see Appending results to ACL tables and text files.

Related concepts
About duplicates
Related tasks
Testing for duplicates


(C) 2013 ACL Services Ltd. All Rights Reserved. | Send feedback