Failing in MiNiFi-Tutorial, toolkit error: Connection with id ... has invalid destination id

seb

I followed this tutorial: Getting started with MiNiFi

Therefore, there is a input port in my root process group and a process group for MiNiFi. The MiNiFi Process Group, contains a Tail File Processor, a Remote Process Groupand a Connection between them.

Inside the MiNiFi Process Group I'm saving the Template, after this I download it from the Templates List and run the command:

minifi-toolkit-0.5.0\bin\config.bat transform minifi\MiNiFi2.xml minifi\minifi_config\config.yml

But it fails and says:

The JAVA_HOME environment variable is not defined correctly.
Instead the PATH will be used to find the java executable.

There are validation errors with the template, still outputting YAML but it will need to be edited.
Connection with id 10de7342-41ef-37a5-0000-000000000000 has invalid destination id 9b02eb45-3c2d-3fb4-91cf-880d5038c0cd

I re-created everything and the issue still exists.

This is my Template:

<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<template encoding-version="1.3">
    <description></description>
    <groupId>db4ce9c5-016e-1000-bce2-b531930a6edd</groupId>
    <name>MiNiFi</name>
    <snippet>
        <connections>
            <id>10de7342-41ef-37a5-0000-000000000000</id>
            <parentGroupId>e544a343-e2f0-3112-0000-000000000000</parentGroupId>
            <backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
            <backPressureObjectThreshold>10000</backPressureObjectThreshold>
            <destination>
                <groupId>1e18bdb9-7df3-3fba-0000-000000000000</groupId>
                <id>9b02eb45-3c2d-3fb4-91cf-880d5038c0cd</id>
                <type>REMOTE_INPUT_PORT</type>
            </destination>
            <flowFileExpiration>0 sec</flowFileExpiration>
            <labelIndex>1</labelIndex>
            <loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
            <loadBalancePartitionAttribute></loadBalancePartitionAttribute>
            <loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
            <loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
            <name></name>
            <selectedRelationships>success</selectedRelationships>
            <source>
                <groupId>e544a343-e2f0-3112-0000-000000000000</groupId>
                <id>246f7d78-f8e1-3c88-0000-000000000000</id>
                <type>PROCESSOR</type>
            </source>
            <zIndex>0</zIndex>
        </connections>
        <processors>
            <id>246f7d78-f8e1-3c88-0000-000000000000</id>
            <parentGroupId>e544a343-e2f0-3112-0000-000000000000</parentGroupId>
            <position>
                <x>0.0</x>
                <y>16.0</y>
            </position>
            <bundle>
                <artifact>nifi-standard-nar</artifact>
                <group>org.apache.nifi</group>
                <version>1.10.0</version>
            </bundle>
            <config>
                <bulletinLevel>WARN</bulletinLevel>
                <comments></comments>
                <concurrentlySchedulableTaskCount>1</concurrentlySchedulableTaskCount>
                <descriptors>
                    <entry>
                        <key>tail-mode</key>
                        <value>
                            <name>tail-mode</name>
                        </value>
                    </entry>
                    <entry>
                        <key>File to Tail</key>
                        <value>
                            <name>File to Tail</name>
                        </value>
                    </entry>
                    <entry>
                        <key>Rolling Filename Pattern</key>
                        <value>
                            <name>Rolling Filename Pattern</name>
                        </value>
                    </entry>
                    <entry>
                        <key>tail-base-directory</key>
                        <value>
                            <name>tail-base-directory</name>
                        </value>
                    </entry>
                    <entry>
                        <key>Initial Start Position</key>
                        <value>
                            <name>Initial Start Position</name>
                        </value>
                    </entry>
                    <entry>
                        <key>File Location</key>
                        <value>
                            <name>File Location</name>
                        </value>
                    </entry>
                    <entry>
                        <key>tailfile-recursive-lookup</key>
                        <value>
                            <name>tailfile-recursive-lookup</name>
                        </value>
                    </entry>
                    <entry>
                        <key>tailfile-lookup-frequency</key>
                        <value>
                            <name>tailfile-lookup-frequency</name>
                        </value>
                    </entry>
                    <entry>
                        <key>tailfile-maximum-age</key>
                        <value>
                            <name>tailfile-maximum-age</name>
                        </value>
                    </entry>
                </descriptors>
                <executionNode>ALL</executionNode>
                <lossTolerant>false</lossTolerant>
                <penaltyDuration>30 sec</penaltyDuration>
                <properties>
                    <entry>
                        <key>tail-mode</key>
                        <value>Single file</value>
                    </entry>
                    <entry>
                        <key>File to Tail</key>
                        <value>/opt/minifi/minifi_test_dir</value>
                    </entry>
                    <entry>
                        <key>Rolling Filename Pattern</key>
                    </entry>
                    <entry>
                        <key>tail-base-directory</key>
                    </entry>
                    <entry>
                        <key>Initial Start Position</key>
                        <value>Beginning of File</value>
                    </entry>
                    <entry>
                        <key>File Location</key>
                        <value>Local</value>
                    </entry>
                    <entry>
                        <key>tailfile-recursive-lookup</key>
                        <value>false</value>
                    </entry>
                    <entry>
                        <key>tailfile-lookup-frequency</key>
                        <value>10 minutes</value>
                    </entry>
                    <entry>
                        <key>tailfile-maximum-age</key>
                        <value>24 hours</value>
                    </entry>
                </properties>
                <runDurationMillis>0</runDurationMillis>
                <schedulingPeriod>0 sec</schedulingPeriod>
                <schedulingStrategy>TIMER_DRIVEN</schedulingStrategy>
                <yieldDuration>1 sec</yieldDuration>
            </config>
            <executionNodeRestricted>false</executionNodeRestricted>
            <name>TailFile</name>
            <relationships>
                <autoTerminate>false</autoTerminate>
                <name>success</name>
            </relationships>
            <state>STOPPED</state>
            <style/>
            <type>org.apache.nifi.processors.standard.TailFile</type>
        </processors>
        <remoteProcessGroups>
            <id>1e18bdb9-7df3-3fba-0000-000000000000</id>
            <parentGroupId>e544a343-e2f0-3112-0000-000000000000</parentGroupId>
            <position>
                <x>696.0</x>
                <y>0.0</y>
            </position>
            <comments></comments>
            <communicationsTimeout>30 sec</communicationsTimeout>
            <contents>
                <inputPorts>
                    <batchSettings/>
                    <comments></comments>
                    <concurrentlySchedulableTaskCount>1</concurrentlySchedulableTaskCount>
                    <connected>true</connected>
                    <exists>true</exists>
                    <groupId>db4d2e20-016e-1000-d3c7-73a67e2b1d67</groupId>
                    <id>9b02eb45-3c2d-3fb4-91cf-880d5038c0cd</id>
                    <name>input_minifi</name>
                    <targetId>dadd7f29-016e-1000-3c91-89495c813674</targetId>
                    <targetRunning>false</targetRunning>
                    <transmitting>false</transmitting>
                    <useCompression>false</useCompression>
                </inputPorts>
            </contents>
            <proxyHost></proxyHost>
            <proxyUser></proxyUser>
            <targetUri>http://nifi-server:8080/nifi</targetUri>
            <targetUris>http://nifi-server:8080/nifi</targetUris>
            <transportProtocol>RAW</transportProtocol>
            <yieldDuration>10 sec</yieldDuration>
        </remoteProcessGroups>
    </snippet>
    <timestamp>12/06/2019 13:04:03 UTC</timestamp>
</template>

This is the toolkit result:

MiNiFi Config Version: 3
Flow Controller:
  name: MiNiFi
  comment: ''
Core Properties:
  flow controller graceful shutdown period: 10 sec
  flow service write delay interval: 500 ms
  administrative yield duration: 30 sec
  bored yield duration: 10 millis
  max concurrent threads: 1
  variable registry properties: ''
FlowFile Repository:
  partitions: 256
  checkpoint interval: 2 mins
  always sync: false
  Swap:
    threshold: 20000
    in period: 5 sec
    in threads: 1
    out period: 5 sec
    out threads: 4
Content Repository:
  content claim max appendable size: 10 MB
  content claim max flow files: 100
  always sync: false
Provenance Repository:
  provenance rollover time: 1 min
  implementation: org.apache.nifi.provenance.MiNiFiPersistentProvenanceRepository
Component Status Repository:
  buffer size: 1440
  snapshot frequency: 1 min
Security Properties:
  keystore: ''
  keystore type: ''
  keystore password: ''
  key password: ''
  truststore: ''
  truststore type: ''
  truststore password: ''
  ssl protocol: ''
  Sensitive Props:
    key:
    algorithm: PBEWITHMD5AND256BITAES-CBC-OPENSSL
    provider: BC
Processors:
- id: 246f7d78-f8e1-3c88-0000-000000000000
  name: TailFile
  class: org.apache.nifi.processors.standard.TailFile
  max concurrent tasks: 1
  scheduling strategy: TIMER_DRIVEN
  scheduling period: 0 sec
  penalization period: 30 sec
  yield period: 1 sec
  run duration nanos: 0
  auto-terminated relationships list: []
  Properties:
    File Location: Local
    File to Tail: /opt/minifi/minifi_test_dir
    Initial Start Position: Beginning of File
    Rolling Filename Pattern:
    tail-base-directory:
    tail-mode: Single file
    tailfile-lookup-frequency: 10 minutes
    tailfile-maximum-age: 24 hours
    tailfile-recursive-lookup: 'false'
Controller Services: []
Process Groups: []
Input Ports: []
Output Ports: []
Funnels: []
Connections:
- id: 10de7342-41ef-37a5-0000-000000000000
  name: TailFile/success/9b02eb45-3c2d-3fb4-91cf-880d5038c0cd
  source id: 246f7d78-f8e1-3c88-0000-000000000000
  source relationship names:
  - success
  destination id: 9b02eb45-3c2d-3fb4-91cf-880d5038c0cd
  max work queue size: 10000
  max work queue data size: 1 GB
  flowfile expiration: 0 sec
  queue prioritizer class: ''
Remote Process Groups:
- id: 1e18bdb9-7df3-3fba-0000-000000000000
  name: ''
  url: http://nifi-server:8080/nifi
  comment: ''
  timeout: 30 sec
  yield period: 10 sec
  transport protocol: RAW
  proxy host: ''
  proxy port: ''
  proxy user: ''
  proxy password: ''
  local network interface: ''
  Input Ports:
  - id: dadd7f29-016e-1000-3c91-89495c813674
    name: input_minifi
    comment: ''
    max concurrent tasks: 1
    use compression: false
  Output Ports: []
NiFi Properties Overrides: {}
Bryan

Edit:

It appears there is a bug in the toolkit (MINIFI-521 reported by @seb) where the targetId is used in the template as the input port id but the connection id isn't being mapped appropriately.

Previous:

If I remember correctly, the toolkit expects the template it processes to be entirely self-contained.

The template is referencing the input port from the root process group.

This will cause it to be missing when only the template is exported and converted for use with MiNiFi.

I'd suggest moving your input port down into the process group that you're going to create a template of.

この記事はインターネットから収集されたものであり、転載の際にはソースを示してください。

侵害の場合は、連絡してください[email protected]

編集
0

コメントを追加

0

関連記事

分類Dev

Appcelerator [ERROR] : Invalid "--device-id" value

分類Dev

Why is _beginthreadex failing with ERROR_INVALID_ACCESS?

分類Dev

Handlebars.js Uncaught Error:Expecting'DATA '、' ID '、got'INVALID'

分類Dev

SignalR Get Connection Id

分類Dev

C++ : data file has error: Expected unqualified-id

分類Dev

Discord.py: 'Context' object has no attribute 'id' error

分類Dev

'RefVariable' object has no attribute '_id'

分類Dev

Type '_' has no member 'id' SwiftUI

分類Dev

Why is my Spring Boot entity ID generation failing?

分類Dev

Rails Grape API 'id is invalid' in request that requires no id

分類Dev

New Apple ID Sign In invalid grant issue

分類Dev

New Apple ID Sign In invalid grant issue

分類Dev

Spotify Android SDK:INVALID_APP_ID

分類Dev

PayPal Billing Agreement - Invalid Plan Id .NET

分類Dev

Salesforce REST API INVALID_SESSION_ID

分類Dev

AWS Cognito with OpenID failing with .NET Core gives error of *Error redeeming code: invalid_client*

分類Dev

python twisted: enforcing a single connection per id

分類Dev

Obscure ssh connection destination server

分類Dev

Grab id of a form that has a child input with a name="id"

分類Dev

Asp.net Core 2.1 or 2.2 BOT SDK 4 invalid activity-missing Conversation.Id error when accessing parameters

分類Dev

How to get data value of a div that has no ID?

分類Dev

SwiftUI ForEach Type '_' has no member 'id'

分類Dev

button in a nested table that has dynamic id

分類Dev

Handling ID's in has_many association

分類Dev

Automate Internet Explorer: enter a value that has no "ID"

分類Dev

MiNiFiで失敗-チュートリアル、ツールキットエラー:IDとの接続...の宛先IDが無効です

分類Dev

Composer 0.13.0 - Error: Missing id

分類Dev

cloudkit: validate a developer ID-signed application error: the archived application has entitlements that require Mac app store distribution

分類Dev

ERROR: Cookbook loaded at path(s) has invalid metadata

Related 関連記事

  1. 1

    Appcelerator [ERROR] : Invalid "--device-id" value

  2. 2

    Why is _beginthreadex failing with ERROR_INVALID_ACCESS?

  3. 3

    Handlebars.js Uncaught Error:Expecting'DATA '、' ID '、got'INVALID'

  4. 4

    SignalR Get Connection Id

  5. 5

    C++ : data file has error: Expected unqualified-id

  6. 6

    Discord.py: 'Context' object has no attribute 'id' error

  7. 7

    'RefVariable' object has no attribute '_id'

  8. 8

    Type '_' has no member 'id' SwiftUI

  9. 9

    Why is my Spring Boot entity ID generation failing?

  10. 10

    Rails Grape API 'id is invalid' in request that requires no id

  11. 11

    New Apple ID Sign In invalid grant issue

  12. 12

    New Apple ID Sign In invalid grant issue

  13. 13

    Spotify Android SDK:INVALID_APP_ID

  14. 14

    PayPal Billing Agreement - Invalid Plan Id .NET

  15. 15

    Salesforce REST API INVALID_SESSION_ID

  16. 16

    AWS Cognito with OpenID failing with .NET Core gives error of *Error redeeming code: invalid_client*

  17. 17

    python twisted: enforcing a single connection per id

  18. 18

    Obscure ssh connection destination server

  19. 19

    Grab id of a form that has a child input with a name="id"

  20. 20

    Asp.net Core 2.1 or 2.2 BOT SDK 4 invalid activity-missing Conversation.Id error when accessing parameters

  21. 21

    How to get data value of a div that has no ID?

  22. 22

    SwiftUI ForEach Type '_' has no member 'id'

  23. 23

    button in a nested table that has dynamic id

  24. 24

    Handling ID's in has_many association

  25. 25

    Automate Internet Explorer: enter a value that has no "ID"

  26. 26

    MiNiFiで失敗-チュートリアル、ツールキットエラー:IDとの接続...の宛先IDが無効です

  27. 27

    Composer 0.13.0 - Error: Missing id

  28. 28

    cloudkit: validate a developer ID-signed application error: the archived application has entitlements that require Mac app store distribution

  29. 29

    ERROR: Cookbook loaded at path(s) has invalid metadata

ホットタグ

アーカイブ