User Tools

Site Tools


excluding_columns

Agent Excluding Column Configuration

The Replicator Agent supports excluding columns from replication. Please note that the preferred approach for excluding columns from being replicated is to leverage capabilities of the producer such as Perspectium Views which provides the ability to define which columns should be replicated.

Configuring columns to be excluded should be done prior to the Agent creating the table which contains the excluded column for clarity. However, it can be done after with no ill affect. That column will just no longer be populated.

You can configure multiple columns to be excluded. To set this up you will have one <exclude_columns>…</exclude_columns> set of tags. Within in it you will define each column to be excluded by individual <exclude_column>…</exclude_column> tags. This will be placed within the <subscribe> element located within the agent.xml configuration file. Example below:

<?xml version="1.0" encoding="ISO-8859-1" standalone="no"?>
<config>
    <agent>
        <subscribe>
     	    <task>
                <task_name>example_subscribe</task_name>
                <message_connection>amqps://example.perspectium.net</message_connection>
                .
                .
                .
            </task>
 
            <exclude_columns>
                <exclude_column>sys_translated_text</exclude_column>
                <exclude_column>fx_price</exclude_column>
                <exclude_column>sys_tags</exclude_column>
            </exclude_columns>
 
        </subscribe>
 
        <max_reads_per_connect>4000</max_reads_per_connect>
        <polling_interval>5</polling_interval>
    </agent>
</config>

In the example above we've added the necessary configuration to exclude the columns:

  • fx_price
  • sys_tags
  • sys_translated_text

Currently, when a column is excluded it's applied to every table which may contain the column.

excluding_columns.txt · Last modified: 2017/09/21 16:12 by jackson.davenport