Exercise 3b: Transforming data and using Data Inspector

Available with Data Interoperability license.

Complexity:

Advanced

Data Requirement:

Installed with software

Data Path:

C:\arcgis\ArcTutor\Data Interoperability\

Goal:

Learn the fundamentals of transforming features and attributes in FME Workbench and using Data Inspector to verify output.

A transformer is an FME Workbench object that performs a particular restructuring of features or schema. It is a visual object that you add to your workspace canvas and connect between the source and destination features, or to other transformers.

This exercise introduces you to the fundamentals of using FME transformers. You create a spatial ETL tool that transforms MGE parcel data and generates new output. Finally, you inspect the output of your workspace without generating data using Data Inspector.

Using FME Workbench, perform the following tasks:

• Add an AreaBuilder transformer to create polygons from the LOT_LINES source feature type.
• Add a PointOnAreaOverlayer transformer to overlay the LOT_POINTS features onto the polygon features and merge their attributes.
• Redirect the output of the workspace to Visualizer and inspect the output of your workspace.

After running the tool and generating the data, add the dataset to ArcMap to verify your results.

Start ArcMap

Prerequisite:

The Data Interoperability extension must be enabled.

Before starting this exercise, you must have completed the previous exercise, Exercise 3a: Getting started with spatial ETL.

1. Start ArcMap.
2. Click Catalog on the Standard toolbar.
3. Type C:\arcgis\ArcTutor\Data Interoperability\parcels\ in the Location text box and press ENTER.

   The location is added to the Catalog tree under Folder Connections.

   

Copy and rename the spatial ETL tool

In this exercise we will be learning the fundamentals of transforming features and attributes in FME Workbench and using Data Inspector to verify output.

1. Right-click the Import MGE Parcel tool and click Copy on the context menu.
2. Right-click the Parcels toolbox and click Paste on the context menu.
3. Right-click the Import MGE Parcel (2) tool, click Rename on the context menu, and type Custom Parcels.
4. Right-click the Custom Parcels tool and click Edit.

   Workbench starts.

Add an AreaBuilder transformer

The AreaBuilder transformer creates topologically correct polygon features from lines that form closed shapes. Connect an AreaBuilder transformer to the LOT_LINES GeometryFilter.

1. Confirm that Transformer Gallery is available.

   To open the Transformer Gallery window from the main menu, click View > Windows > Transformer Gallery.

   

2. In the Transformers Gallery window, type areabuilder in the Search text box and press ENTER.
3. Double-click AreaBuilder.

   An AreaBuilder transformer is added to the canvas.

4. Click the line connecting the LOT_LINES GeometryFilter and the LOT_LINES destination feature and press DELETE.

   The GeometryFilter is disconnected from the destination feature type.

5. On the LOT_LINES GeometryFilter, click the yellow arrow beside the LINE attribute output.
6. Click the red arrow beside the AreaBuilder input.

   The GeometryFilter output is connected to the AreaBuilder input and the arrow turns green.

Add a PointOnAreaOverlayer transformer

The PointOnAreaOverlayer transformer overlays point features onto area features and merges their attributes. As a result, each polygon feature acquires attributes from the point feature contained within its boundary. Attributes with the same name are not replaced.

Connect a PointOnAreaOverlayer transformer to the LOT_LINES AreaBuilder transformer and the LOT_POINTS GeometryFilter.

1. In the Transformer Gallery window, type PointOnArea in the Search text box.
2. Double-click PointOnAreaOverlayer.

   A PointOnAreaOverlayer transformer is added to the canvas.

3. Click the line connecting the LOT_POINTS GeometryFilter and the LOT_POINTS destination feature type and press DELETE.

   The GeometryFilter is disconnected from the destination feature type.

4. On the LOT_POINTS GeometryFilter, click the yellow arrow beside the POINT output.
5. Click the red arrow beside the PointOnAreaOverlayer POINT input.

   The GeometryFilter POINT output is connected to the PointOnAreaOverlayer POINT input and the arrow turns green.

6. On the AreaBuilder Transformer, click the red arrow beside the AREA output.
7. Click the red arrow beside the PointOnAreaOverlayer AREA input.

   The AreaBuilder AREA output is connected to the PointOnAreaOverlayer AREA input and the arrow turns green.

   

Organizing the canvas layout

At this time, the connectors may begin to cross over each other and appear confusing. There are several ways to organize the canvas layout:

• Click Tools > Auto Layout.
• Manually click and drag the objects on the canvas.
• Right-click a connector line, click Insert Vertex on Connection on the context menu to add one more vertex, and drag each vertex to route the connector around other transformers.

Redefine the LOT_POINTS destination feature

Redefine the LOT_POINTS destination feature to generate the polygon features.

1. Connect the AREA output on the PointOnAreaOverlayer transformer to the INPUT on the LOT_POINTS destination feature.

   

2. Click the Properties button on the LOT_POINTS destination feature.

   The Feature Type Properties dialog box opens.

   

3. Click the General tab.
4. In the Feature Type Name text box, type parcels.
5. Click the Allowed Geometries arrow and choose geodb_polyline.
6. Click the User Attributes tab.

   

7. Select only the attributes with names that start with igds_ and click Removes the current row control (–).
The igds_ attributes are symbolic names created by the FME reader to clarify the translation of the IGDS source element types to FME feature types. There is no need to include them with the destination features.
8. Click OK.
9. The Feature Type Properties dialog box closes.

Verify the output of your workspace with Data Inspector

Data Inspector is an in-memory viewer that enables you to inspect the output of your workspace without generating data or overwriting existing data.

Redirect the output of your workspace to Data Inspector and verify your results.

1. In the Navigator window, expand Tool Parameters, right-click Destination Redirect, and click Edit Parameter Value from the context menu.

   The Edit Parameter dialog box opens.

   

2. Click the Destination Redirect arrow and choose Redirect to Inspection Application.
3. Click OK.

   The Edit Parameter dialog box closes.

4. On the main menu, click File > Run Translation.

   Data Inspector starts.

   

5. Expand the datasets in Viewspace.
6. Click the Select tool on the toolbar, select features, and explore their attribute values displayed in the Feature Information window.
Observe that the workspace creates polygons from line elements stored in the MicroStation DGN (.par) files and acquires the point feature attributes stored in the parcels_attr.mdb database.
7. Exit Data Inspector.
8. (Optional) If you want to write the data the next time you run this workspace, repeat Step 1 in the Workbench Navigator window, and in the Edit Parameter dialog box, select No Redirect.
9. On the Workbench menu, click File > Save.

This completes the exercise.

Advanced tasks

Optionally complete the following exercises on your own:

• Insert a Tester transformer into the workspace to test the Overlap Count attribute generated by the PointOnOverlayer transformer. Polygon features that contain one point feature pass the test and are directed to the LOT_POINTS destination feature. Polygon features that do not contain one point feature fail the test and are directed to the LOT_LINES destination feature.
• Save the spatial ETL tool as a custom format. A custom format is a translation workspace exported as a format and utilized in the FME reader gallery. It is saved to an external (.fds) file and can be imported to reader galleries on other desktops.