Adding Documents to EDR

Prev Next

Users with the required Permissions can upload documents into Electronic Document Review using one of two methods:

  1. From the Local Disk/Network

  2. From the EDR File Server

Notes: The limit on uploads from a local disk has been increased to 10 GB. Note that if uploading a large file from a local disk, the upload window cannot be closed until the process completes.
When adding documents from the file server, documents can only be added from the data path provided during EDR configuration. This source location must contain all documents necessary for EDR processing. To add documents from the file server, coordinate with your FOIAXpress Administrator.
When EDR is configured with multiple databases, the system automatically distributes jobs amongst the available databases based on database size. Therefore, the current smallest database will always be issued the next EDR job. The distribution is determined only by the size of the available databases.

Steps to Add Documents from the File Server

Follow the steps below to add documents from the EDR File Server.

  1. Open a Request for which you want to add documents to EDR.

  2. Click Electronic Document Review. The EDR - Add Documents screen displays as shown below.

  3. Under Data Source, click From EDR File Server. The Browse Folder window appears, displaying the path to the data source. (This location was provided during EDR configuration). Use the Folder Name field to locate the folder from which you'd like to add files.

  4. Click on a folder, then click Select. The EDR - Add Documents screen will change to display the data source path.

  5. To enable clustering, select the Enable Clustering checkbox. The checkboxes that appear are described in the table below (see Cluster Sets for more information on Clustering).

Note: Hover over each setting in the Clustering Settings section to display tooltips with additional clustering details

Field

Description

Create Containment Cluster

If selected, it provides the option to view which documents/emails are contained within other documents/emails

Create Relevancy Cluster

When this checkbox is selected, the application will create a relevancy cluster based on selections made for the options below. Selecting this checkbox will automatically select these options, which can also be selected individually.

  • Request Description: A description of the Request.

  • Request Keywords: Words or phrases related to the Request.

  1. Under Data Source Processing Settings, set up the Document Review options. The following options are available:

Setting

Description

De-dup across all document types

Finds duplicates/near duplicates; excludes metadata (requires clustering)

De-dup by document type

Finds exact duplicates; includes metadata (does not require clustering)

  1. Under Data Source Processing Settings, set up the Document Review options. The following options are available:

Setting

Description

De-dup across all document types

Finds duplicates/near duplicates; excludes metadata (requires clustering)

De-dup by document type

Finds exact duplicates; includes metadata (does not require clustering)

  1. Under Email Attachment, select the desired Email index setting. These are described below:

Setting

Description

Keep email body and attachments as separate documents

Attachments will be separated from emails for deduplication; association to parent email will be retained.

Keep email body and attachments as single document

Attachments will be appended to the parent email; and will not be deduped against original document types.

Note: The default setting is configured under Administration > Electronic Document Review (EDR) > EDR Configuration > Email Handling.

Note: To properly ingest documents that are embedded within Word documents, select Keep email body and attachments as single document.

Note: Any documents in unsupported formats are ignored by the system and are not included in the ingestion. This ensures all supported documents are included and ingested. See the EDR Process Summary Report's Export Rejected Items option to see any rejected attachments.

11. Click Next. The screen will move to step 2, where the ingestion details are confirmed:

  1. Click Finish. The next screen shows the system indexing and ingesting the uploaded documents to formulate clusters, as shown below.

  2. Please wait while the data source is properly loaded. Once the upload and process documents jobs are completed, the screen will change to display a confirmation message and links to summary information, as shown below.

  3. The following options are available from this screen:

Field

Description

Go to Document Review

When this button is clicked, a screen will open where you can review the document.

Data Source Summary

View a summary of ingestion details regarding the source of the ingested data

Conceptual Cluster Summary

View a summary of conceptual clusters contained in the data

The data is now present in EDR for this Request. Click Go to Document Review to begin EDR processing.

Data Source Summary

This summary provides information about the original files that were loaded into EDR under a particular Request, and includes the name of the folder and path where the documents are located. This information is accessible by clicking the Data Source Summary link in the Summary section of the Add Documents Results screen.

Containment Cluster Summary

This summary provides information about the embedded email messages.  The Cluster Set Settings, Cluster Set Summary and Warning Messages are system-generated information. This information is accessible by clicking the Containment Cluster Summary link in the Summary section of the Add Documents Results screen..

Cluster Set Information

This summary provides information pertaining to documents deemed significant for review based on Request search criteria. The Cluster Set Settings, Cluster Set Summary and Warning Messages are system-generated information. This information is accessible by clicking the Conceptual Cluster Summary link in the Summary section of the Add Documents Results screen.

Steps to Add Documents from a Local Disk

Users with the required Permissions can upload documents into Electronic Document Review from a Local Disk/Network. Follow the steps below to add documents from your local disk:

  1. Open a Request for which you want to add documents to EDR.

  2. Click Electronic Document Review. The EDR - Add Documents screen displays as shown below.

  3. Click From Local Disk/Network. The Select files to be uploaded screen displays as shown below.

  4. Click Select.

  5. Locate and select the files you want to upload, then click Open.

  6. The selected files appears on the Select files to be uploaded screen. If you want to remove the file, click Remove next to the file name.

  7. Click Upload. A confirmation message appears.

  8. Click to OK confirm the files. The Step 1 screen appears again.  

  9. To enable clustering, select the Enable Clustering checkbox. The checkboxes that appear are described in the table below (see Cluster Sets for more information on Clustering).

Field

Description

Create Containment Cluster

If selected, provides option to view which documents/emails are contained within other documents/emails

Create Relevancy Cluster

When this checkbox is selected, the application will create a relevancy cluster based on selections made for the options below. Selecting this checkbox will automatically select these options, which can also be selected individually.

  • Request Description: A description of the Request.

  • Request Keywords: Words or phrases related to the Request.

  1. Under Data Source Processing Settings, set up the Document Review options. The following options are available:

Setting

Description

De-dup across all document types

Finds duplicates/near duplicates; excludes metadata (requires clustering)

De-dup by document type

Finds exact duplicates; includes metadata (does not require clustering)

  1. Under Email Attachment, select the desired Email index setting. These are described below:

NOTE: The default setting is configured under Administration > Electronic Document Review (EDR) > EDR Configuration > Email Handling.

NOTE: To properly ingest documents that are embedded within Word documents, select Keep email body and attachments as single document.

  1. Click Next. The screen will move to step 2, where the ingestion details are confirmed.

  2. Click Finish. The system will start uploading the file into the designated location provided during EDR setup.

  3. After the ingestion is complete, the confirmation screen appears as shown below:

  4. The following options are available from this screen:

Field

Description

Go to Document Review

When this button is clicked, a screen will open where you can review the document.

Data Source Summary

View a summary of ingestion details regarding the source of the ingested data

Conceptual Cluster Summary

View a summary of conceptual clusters contained in the data

  1. Click Go to Document Review to open EDR for document processing.

Click the links below for additional information:

Performing Document Review

Review Lists

Adding Documents to the Review Log

Adding Documents to the Request Folder