--- /dev/null
+===============
+CDAP Broker API
+===============
+
+:Date: 2017-10-09
+
+.. contents::
+ :depth: 3
+..
+
+Overview
+========
+
+Version information
+-------------------
+
+*Version* : 4.0.10
+
+Paths
+=====
+
+GET /
+-----
+
+Description
+~~~~~~~~~~~
+
+shows some information about this service
+
+Responses
+~~~~~~~~~
+
++---------+----------------------------------------------------+----------------+
+| HTTP | Description | Schema |
+| Code | | |
++=========+====================================================+================+
+| **200** | successful response | `info <#_info> |
+| | | `__ |
++---------+----------------------------------------------------+----------------+
+
+GET /application
+----------------
+
+Description
+~~~~~~~~~~~
+
+get all applications registered with this broker
+
+Responses
+~~~~~~~~~
+
++---------+----------------------------------------------------+----------------+
+| HTTP | Description | Schema |
+| Code | | |
++=========+====================================================+================+
+| **200** | successful response | < |
+| | | `appname <#_ap |
+| | | pname>`__ |
+| | | > array |
++---------+----------------------------------------------------+----------------+
+
+PUT /application\*/{appname}
+----------------------------
+
+Description
+~~~~~~~~~~~
+
+(This is a hacky way of supporting "oneOf" because Swagger does not
+support oneOf https://github.com/OAI/OpenAPI-Specification/issues/333.
+This is the same endpoint as PUT /application/appname, except the PUT
+body is different.)
+
+Register a hydrator app for service and configuration discovery. This
+will light up a metrics and health endpoint for this app. ``appname`` is
+assumed to also be the key in consul.
+
+Parameters
+~~~~~~~~~~
+
++---------+-------------+--------------------------------------+------------------+
+| Type | Name | Description | Schema |
++=========+=============+======================================+==================+
+| **Path* | | **appname | Name of the application. | string (text) |
+| * | ** | | |
+| | | *required | | |
+| | * | | |
++---------+-------------+--------------------------------------+------------------+
+| **Body* | | **putbody | required put body | `hydratorappput |
+| * | ** | | <#_hydratorapppu |
+| | | *required | | t>`__ |
+| | * | | |
++---------+-------------+--------------------------------------+------------------+
+
+Responses
+~~~~~~~~~
+
++---------+----------------------------------------------------+----------------+
+| HTTP | Description | Schema |
+| Code | | |
++=========+====================================================+================+
+| **200** | Successful response | `Application < |
+| | | #_application> |
+| | | `__ |
++---------+----------------------------------------------------+----------------+
+| **400** | put was performed but the appname was already | No Content |
+| | registered with the broker, or Invalid PUT body | |
++---------+----------------------------------------------------+----------------+
+
+Consumes
+~~~~~~~~
+
+- ``application/json``
+
+Produces
+~~~~~~~~
+
+- ``application/json``
+
+POST /application/delete
+------------------------
+
+Description
+~~~~~~~~~~~
+
+endpoint to delete multiple applications at once. Returns an array of
+status codes, where statuscode[i] = response returned from
+DELETE(application/i)
+
+Parameters
+~~~~~~~~~~
+
++---------+-------------+--------------------------------------+------------------+
+| Type | Name | Description | Schema |
++=========+=============+======================================+==================+
+| **Body* | | **postbod | required post body | `multideleteput |
+| * | y** | | <#_multideletepu |
+| | | *required | | t>`__ |
+| | * | | |
++---------+-------------+--------------------------------------+------------------+
+
+Responses
+~~~~~~~~~
+
++---------+----------------------------------------------------+----------------+
+| HTTP | Description | Schema |
+| Code | | |
++=========+====================================================+================+
+| **200** | successful response | < |
+| | | `returncode <# |
+| | | _returncode>`_ |
+| | | _ |
+| | | > array |
++---------+----------------------------------------------------+----------------+
+
+GET /application/{appname}
+--------------------------
+
+Description
+~~~~~~~~~~~
+
+Returns the representation of the application resource, including the
+links for healthcheck and metrics.
+
+Parameters
+~~~~~~~~~~
+
++---------+-------------+--------------------------------------+------------------+
+| Type | Name | Description | Schema |
++=========+=============+======================================+==================+
+| **Path* | | **appname | Name of the application. | string (text) |
+| * | ** | | |
+| | | *required | | |
+| | * | | |
++---------+-------------+--------------------------------------+------------------+
+
+Responses
+~~~~~~~~~
+
++---------+----------------------------------------------------+----------------+
+| HTTP | Description | Schema |
+| Code | | |
++=========+====================================================+================+
+| **200** | Successful response | `Application < |
+| | | #_application> |
+| | | `__ |
++---------+----------------------------------------------------+----------------+
+| **404** | no app with name 'appname' registered with this | No Content |
+| | broker. | |
++---------+----------------------------------------------------+----------------+
+
+PUT /application/{appname}
+--------------------------
+
+Description
+~~~~~~~~~~~
+
+Register an app for service and configuration discovery. This will light
+up a metrics and health endpoint for this app. ``appname`` is assumed to
+also be the key in consul.
+
+Parameters
+~~~~~~~~~~
+
++---------+-------------+--------------------------------------+------------------+
+| Type | Name | Description | Schema |
++=========+=============+======================================+==================+
+| **Path* | | **appname | Name of the application. | string (text) |
+| * | ** | | |
+| | | *required | | |
+| | * | | |
++---------+-------------+--------------------------------------+------------------+
+| **Body* | | **putbody | required put body | `appput <#_apppu |
+| * | ** | | t>`__ |
+| | | *required | | |
+| | * | | |
++---------+-------------+--------------------------------------+------------------+
+
+Responses
+~~~~~~~~~
+
++---------+----------------------------------------------------+----------------+
+| HTTP | Description | Schema |
+| Code | | |
++=========+====================================================+================+
+| **200** | Successful response | `Application < |
+| | | #_application> |
+| | | `__ |
++---------+----------------------------------------------------+----------------+
+| **400** | put was performed but the appname was already | No Content |
+| | registered with the broker, or Invalid PUT body | |
++---------+----------------------------------------------------+----------------+
+
+Consumes
+~~~~~~~~
+
+- ``application/json``
+
+Produces
+~~~~~~~~
+
+- ``application/json``
+
+DELETE /application/{appname}
+-----------------------------
+
+Description
+~~~~~~~~~~~
+
+Remove an app for service and configuration discovery. This will remove
+the metrics and health endpoints for this app.
+
+Parameters
+~~~~~~~~~~
+
++---------+-------------+--------------------------------------+------------------+
+| Type | Name | Description | Schema |
++=========+=============+======================================+==================+
+| **Path* | | **appname | Name of the application. | string (text) |
+| * | ** | | |
+| | | *required | | |
+| | * | | |
++---------+-------------+--------------------------------------+------------------+
+
+Responses
+~~~~~~~~~
+
++---------+----------------------------------------------------+----------------+
+| HTTP | Description | Schema |
+| Code | | |
++=========+====================================================+================+
+| **200** | Successful response | No Content |
++---------+----------------------------------------------------+----------------+
+| **404** | no app with name 'appname' registered with this | No Content |
+| | broker. | |
++---------+----------------------------------------------------+----------------+
+
+GET /application/{appname}/healthcheck
+--------------------------------------
+
+Description
+~~~~~~~~~~~
+
+Perform a healthcheck on the running app appname.
+
+Parameters
+~~~~~~~~~~
+
++---------+-------------+--------------------------------------+------------------+
+| Type | Name | Description | Schema |
++=========+=============+======================================+==================+
+| **Path* | | **appname | Name of the application to get the | string (test) |
+| * | ** | healthcheck for. | |
+| | | *required | | |
+| | * | | |
++---------+-------------+--------------------------------------+------------------+
+
+Responses
+~~~~~~~~~
+
++---------+----------------------------------------------------+----------------+
+| HTTP | Description | Schema |
+| Code | | |
++=========+====================================================+================+
+| **200** | Successful response, healthcheck pass | No Content |
++---------+----------------------------------------------------+----------------+
+| **404** | no app with name 'appname' registered with this | No Content |
+| | broker, or the healthcheck has failed (though I | |
+| | would like to disambiguiate from the first case, | |
+| | CDAP returns a 404 for this). | |
++---------+----------------------------------------------------+----------------+
+
+GET /application/{appname}/metrics
+----------------------------------
+
+Description
+~~~~~~~~~~~
+
+Get live (real-time) app specific metrics for the running app appname.
+Metrics are customized per each app by the component developer
+
+Parameters
+~~~~~~~~~~
+
++---------+-------------+--------------------------------------+------------------+
+| Type | Name | Description | Schema |
++=========+=============+======================================+==================+
+| **Path* | | **appname | Name of the application to get | string (test) |
+| * | ** | metrics for. | |
+| | | *required | | |
+| | * | | |
++---------+-------------+--------------------------------------+------------------+
+
+Responses
+~~~~~~~~~
+
++---------+----------------------------------------------------+----------------+
+| HTTP | Description | Schema |
+| Code | | |
++=========+====================================================+================+
+| **200** | Successful response | `MetricsObject |
+| | | <#_metricsobj |
+| | | ect>`__ |
++---------+----------------------------------------------------+----------------+
+| **404** | no app with name 'appname' registered with this | No Content |
+| | broker. | |
++---------+----------------------------------------------------+----------------+
+
+PUT /application/{appname}/reconfigure
+--------------------------------------
+
+Description
+~~~~~~~~~~~
+
+Reconfigures the application.
+
+Parameters
+~~~~~~~~~~
+
++---------+-------------+--------------------------------------+------------------+
+| Type | Name | Description | Schema |
++=========+=============+======================================+==================+
+| **Path* | | **appname | Name of the application. | string (text) |
+| * | ** | | |
+| | | *required | | |
+| | * | | |
++---------+-------------+--------------------------------------+------------------+
+| **Body* | | **putbody | required put body | `reconfigput <#_ |
+| * | ** | | reconfigput>`__ |
+| | | *required | | |
+| | * | | |
++---------+-------------+--------------------------------------+------------------+
+
+Responses
+~~~~~~~~~
+
++---------+----------------------------------------------------+----------------+
+| HTTP | Description | Schema |
+| Code | | |
++=========+====================================================+================+
+| **200** | Successful response | No Content |
++---------+----------------------------------------------------+----------------+
+| **400** | Bad request. Can happen with 1) {appname} is not | No Content |
+| | registered with the broker, 2) the required PUT | |
+| | body is wrong, or 3) the smart interface was | |
+| | chosen and none of the config keys match anything | |
+| | in app\_config or app\_preferences | |
++---------+----------------------------------------------------+----------------+
+
+Definitions
+===========
+
+Application
+-----------
+
++-------------+---------------------------------------------+------------------+
+| Name | Description | Schema |
++=============+=============================================+==================+
+| | **appname | application name | string |
+| ** | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **connect | input URL that you can POST data into (URL | string |
+| ionurl** | of the CDAP stream) | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **healthc | fully qualified url to perform healthcheck | string |
+| heckurl** | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **metrics | fully qualified url to get metrics from | string |
+| url** | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **service | a list of HTTP services exposed by this | < |
+| endpoints** | CDAP application | `service\_method |
+| | *optional | | <#_service_meth |
+| * | | od>`__ |
+| | | > array |
++-------------+---------------------------------------------+------------------+
+| | **url** | fully qualified url of the resource | string |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+
+MetricsObject
+-------------
+
+key,value object where the key is 'appmetrics' and the value is an app
+dependent json and specified by the component developer
+
++--------------------------------+-------------------------------------------+
+| Name | Schema |
++================================+===========================================+
+| | **appmetrics** | object |
+| | *optional* | |
++--------------------------------+-------------------------------------------+
+
+appname
+-------
+
+an application name
+
+*Type* : string
+
+appput
+------
+
++-------------+---------------------------------------------+------------------+
+| Name | Description | Schema |
++=============+=============================================+==================+
+| | **app\_co | the application config JSON | object |
+| nfig** | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **app\_pr | the application preferences JSON | object |
+| eferences** | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **artifac | the name of the CDAP artifact to be added | string |
+| t\_name** | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **cdap\_a | denotes whether this is a program-flowlet | enum |
+| pplication\ | style application or a hydrator pipeline. | (program-flowlet |
+| _type** | For program-flowlet style apps, this value | ) |
+| | *optional | must be "program-flowlet" | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **jar\_ur | the URL that the JAR you’re deploying | string |
+| l** | resides | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **namespa | the cdap namespace this is deployed into | string |
+| ce** | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **program | | < |
+| \_preferenc | | `programpref <#_ |
+| es** | | programpref>`__ |
+| | *optional | | > array |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **program | | < |
+| s** | | `programs <#_pro |
+| | *optional | | grams>`__ |
+| * | | > array |
++-------------+---------------------------------------------+------------------+
+| | **service | | < |
+| s** | | `service\_endpoi |
+| | *optional | | nt <#_service_en |
+| * | | dpoint>`__ |
+| | | > array |
++-------------+---------------------------------------------+------------------+
+| | **streamn | name of the CDAP stream to ingest data into | string |
+| ame** | this app. Should come from the developer | |
+| | *optional | and Tosca model. | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+
+hydratorappput
+--------------
+
++-------------+---------------------------------------------+------------------+
+| Name | Description | Schema |
++=============+=============================================+==================+
+| | **cdap\_a | denotes whether this is a program-flowlet | enum |
+| pplication\ | style application or a hydrator pipeline. | (hydrator-pipeli |
+| _type** | For hydrator, this value must be | ne) |
+| | *required | "hydrator-pipeline" | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **depende | represents a list of dependencies to be | < |
+| ncies** | loaded for this pipeline. Not required. | `hydratordep <#_ |
+| | *optional | | hydratordep>`__ |
+| * | | > array |
++-------------+---------------------------------------------+------------------+
+| | **namespa | the cdap namespace this is deployed into | string |
+| ce** | | |
+| | *required | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **pipelin | the URL of the config.json for this | string |
+| e\_config\_ | pipeline | |
+| json\_url** | | |
+| | *required | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **streamn | name of the CDAP stream to ingest data into | string |
+| ame** | this app. Should come from the developer | |
+| | *required | and Tosca model. | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+
+hydratordep
+-----------
+
+represents a hydrator pipeline dependency. An equivelent to the
+following CURLs are formed with the below four params shown in CAPS
+"curl -v -w"\\n" -X POST
+http://cdapurl:11015/v3/namespaces/setelsewhere/artifacts/ARTIFACT_NAME
+-H "Artifact-Extends:ARTIFACT\_EXTENDS\_HEADER" -H
+“Artifact-Version:ARTIFACT\_VERSION\_HEADER” –data-binary @(DOWNLOADED
+FROM ARTIFACT\_URL)","curl -v -w"\\n" -X PUT
+http://cdapurl:11015/v3/namespaces/setelsewhere/artifacts/ARTIFACT_NAME/versions/ARTIFACT_VERSION_HEADER/properties
+-d (DOWNLOADED FROM UI\_PROPERTIES\_URL)"
+
++-------------+---------------------------------------------+------------------+
+| Name | Description | Schema |
++=============+=============================================+==================+
+| | **artifac | the value of the header that gets passed in | string |
+| t\_extends\ | for artifact-extends, e.g., | |
+| _header** | "Artifact-Extends:system:cdap-data-pipeline | |
+| | *required | [4.0.1,5.0.0)" | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **artifac | the name of the artifact | string |
+| t\_name** | | |
+| | *required | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **artifac | the URL of the artifact JAR | string |
+| t\_url** | | |
+| | *required | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **artifac | the value of the header that gets passed in | string |
+| t\_version\ | for artifact-version, e.g., | |
+| _header** | "Artifact-Version:1.0.0-SNAPSHOT" | |
+| | *required | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **ui\_pro | the URL of the properties.json if the | string |
+| perties\_ur | custom artifact has UI properties. This is | |
+| l** | optional. | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+
+info
+----
+
+some broker information
+
++-------------+---------------------------------------------+------------------+
+| Name | Description | Schema |
++=============+=============================================+==================+
+| | **broker | the API version of this running broker | string |
+| API | | |
+| version** | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **cdap | The GUI port of the CDAP cluster this | integer |
+| GUI | broker is managing. Mostly to help users of | |
+| port** | this API check their application in cdap. | |
+| | *optional | Note, will return UNKNOWN\_CDAP\_VERSION if | |
+| * | it cannot be determined. | |
++-------------+---------------------------------------------+------------------+
+| | **cdap | the version of the CDAP cluster this broker | string |
+| cluster | is managing. Note, will return | |
+| version** | UKNOWN\_CDAP\_VERSION if it cannot be | |
+| | *optional | determined. | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **managed | the url of the CDAP cluster API this broker | string |
+| cdap | is managing | |
+| url** | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **number | | integer |
+| of | | |
+| applicati | | |
+| ons | | |
+| registere | | |
+| d** | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **uptime | | integer |
+| (s)** | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+
+multideleteput
+--------------
+
++--------------------------------+-------------------------------------------+
+| Name | Schema |
++================================+===========================================+
+| | **appnames** | < `appname <#_appname>`__ > array |
+| | *optional* | |
++--------------------------------+-------------------------------------------+
+
+programpref
+-----------
+
+the list of programs in this CDAP app
+
++-------------+---------------------------------------------+------------------+
+| Name | Description | Schema |
++=============+=============================================+==================+
+| | **program | the name of the program | string |
+| \_id** | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **program | the preference JSON to set for this program | object |
+| \_pref** | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **program | must be one of flows, mapreduce, schedules, | string |
+| \_type** | spark, workflows, workers, or services | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+
+programs
+--------
+
+the list of programs in this CDAP app
+
++-------------+---------------------------------------------+------------------+
+| Name | Description | Schema |
++=============+=============================================+==================+
+| | **program | the name of the program | string |
+| \_id** | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **program | must be one of flows, mapreduce, schedules, | string |
+| \_type** | spark, workflows, workers, or services | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+
+reconfigput
+-----------
+
++-------------+---------------------------------------------+------------------+
+| Name | Description | Schema |
++=============+=============================================+==================+
+| | **config* | the config JSON | object |
+| * | | |
+| | *required | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **reconfi | the type of reconfiguration | enum |
+| guration\_t | | (program-flowlet |
+| ype** | | -app-config, |
+| | *required | | program-flowlet- |
+| * | | app-preferences, |
+| | | program-flowlet- |
+| | | smart) |
++-------------+---------------------------------------------+------------------+
+
+returncode
+----------
+
+an httpreturncode
+
+*Type* : integer
+
+service\_endpoint
+-----------------
+
+descirbes a service endpoint, including the service name, the method
+name, and the method type (GET, PUT, etc, most of the time will be GET)
+
++-------------+---------------------------------------------+------------------+
+| Name | Description | Schema |
++=============+=============================================+==================+
+| | **endpoin | GET, POST, PUT, etc | string |
+| t\_method** | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **service | the name of the endpoint on the service | string |
+| \_endpoint* | | |
+| * | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **service | the name of the service | string |
+| \_name** | | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+
+service\_method
+---------------
+
+a URL and HTTP method exposed via a CDAP service
+
++-------------+---------------------------------------------+------------------+
+| Name | Description | Schema |
++=============+=============================================+==================+
+| | **method* | HTTP method you can perform on the URL, | string |
+| * | e.g., GET, PUT, etc | |
+| | *optional | | |
+| * | | |
++-------------+---------------------------------------------+------------------+
+| | **url** | the fully qualified URL in CDAP for this | string |
+| | *optional | service | |
+| * | | |
++-------------+---------------------------------------------+------------------+
Code Review / doc.git / blobdiff