As a technical analyst in the GIS department, you were involved in a recent assignment to set up a Directory Watch solution for users to automatically update the corporate database.

Having learned that not all users are able to access the internal network where FME Server is hosted, you think that it should be possible to also set up a system that uses email-based automation to handle the same updates.

1) Create Resource Folder The first step is to create another Resource folder where all the email attachments will be saved. Log into the FME Server web interface, navigate to Resources > Data, and then create a new folder called Emails.

2) Create Topic
Next, Navigate to the Notifications page. Click the Publications tab and then select New.

Enter "Email Receiver" as the Name. Then click on the text box under Topics to Publish To. Type in ShapeIncomingEmail and click on it to add. This will create a new Topic and assign it to this Publication.

The new Publication can be created to use either the Email (SMTP) protocol or the Email (IMAP) protocol.

SMTP is easier to set up, but FME Server must reside on a server with a proper DNS record (all FME Cloud and Training machines will have this). IMAP is necessary when FME Server resides on an internal network.

Email Protocol

To use the SMTP protocol select Email (SMTP) as the Publication Protocol. This will open the Email User Name parameter. Enter a name for receiving email, for example: fmeshapeprocessing

Clicking OK will create an email address fmeshapeprocessing@<hostname> - for example:

Now all emails sent to that address will trigger the ShapeIncomingEmail topic.

IMAP Protocol

To use the IMAP protocol select Email (IMAP) as the Publication Protocol. This will open a number of other parameters. Enter them according to your email account.

In case it is of use, the server information for Gmail, Outlook, and Yahoo! are as follows:

You will also need to check the settings in your email account to make sure IMAP is turned on. Regardless of the email provider, you should set these parameters as follows:

You may select any Resource folder for attachments to be saved to; but (if you have already completed exercise 1-3) don't choose the BuildingUpdates folder, or else you'll cause the previous topics to be triggered by each email attachment!

3) Test Publication
Now let's test the publication. In the Notifications page on FME Server, click the tab marked Topics. Set up Topic Monitoring to watch the topic ShapeIncomingEmail:

Now send an email with an attachment to the address selected for the new publication. When the email is received by FME Server (SMTP), or FME Server fetches it (IMAP), the topic will be triggered with a message. (Remember that an IMAP publication only checks for an email every 60 seconds, so the result might not be immediate!)

Recall that in the previous exercise you used the Logger Protocol and Logger transformers to record the JSON formatted notification message. The same information is displayed in the Topic Monitoring window. So copy the text from the Topic Monitoring window and paste it into a text editor for use later in this exercise.

4) Update Workspace
You already have a created a workspace in FME Workbench to handle incoming notifications from Directory Watch. Let's modify the workflow so that it can work with both Publication protocols. Open the existing workspace C:\FMEData2018\Workspaces\ServerAuthoring\RealTime-Ex4-Begin.fmw in FME Workbench.

Open the JSONFlattener parameters, and add imap_publisher_attachment{0} and email_publisher_attachment{0} under Attributes to Expose:

You can see these are two of the available attributes that are returned by the Topic Message.

5) Add AttributeManager
The next step is to insert a transformer that will determine where the data is coming from (Directory Watch or an Email Publication) - this is a task where conditional statements are invaluable.

Add an AttributeManager transformer in between the JSONFlattener and FeatureReader. Open the parameters and add _dataset as a new Output Attribute.

Select, from the drop-down menu, the option to set the attribute as a Conditional Value:

Configure the Conditional Value as follows:

In other words:

• If dirwatch_publisher_path has a value, then copy that value into the _dataset attribute.
• Else, if email_publisher_attachment{0} has a value, then copy that value into the _dataset attribute.
• Else, if imap_publisher_attachment{0} has a value, then copy that value into the _dataset attribute.

So _dataset gets the location of the data to be processed, whether it comes from the directory watch notification, or an email notification of either type.

6) Edit FeatureReader
The final step is to change the Dataset parameter in the FeatureReader transformer. Instead of pointing to dirwatch_publisher_path, it should be changed to point at the new _dataset attribute:

The workflow should now look like this:

7) Edit User Parameter
As with Exercise 3, specify the output dataset to be written into the FME Server Resources Folder.

Locate the user parameter DestDataset_SPATIALITE (under User Parameters > Published Parameters in the Navigator window) and double-click it to open an editor dialog.

In that dialog enter:

    $(FME_SHAREDRESOURCE_DATA)/Output/building_footprints.sl3*

8) Publish Workspace
Publish this workspace to FME Server, registering it under the Notification service. When the Notification service is selected, it is highlighted in red indicating its parameters need to be configured.

Click the "Edit" button and set ShapeIncomingEmail for the "Subscribe to Topics" parameter. Set the "Parameter to Get Topic Message" as Source Text File(s):

9) Update Directory Watch Subscription (Optional)
If you have completed Exercise 3, using the FME Server web interface you can set the "Process Building Updates" Subscription to point at this new workspace.

10) Test Workspace
Test the workspace by sending an email to the Publication email address. Be sure to attach a zip file of the Shapefile datasets (.dbf, .prj, .shp, .shx) from C:\FMEData2018\Data\Engineering\BuildingFootprints to the email.

You can verify if the workflow was successful by checking the Completed Jobs page and the timestamp of the SpatiaLite database in Resources > Data > Output in the FME Server web interface.