Skip to content

Documentation #29

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Jul 10, 2017
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
74 changes: 61 additions & 13 deletions dd-trace-examples/spring-boot-jdbc/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,29 +4,77 @@
This project aims at demonstrating how to instrument legacy code based on the SpringBoot framework
and a MySQL JDBC connection.

Along with the [opentracing agent](https://github.com/opentracing-contrib/java-agent) we use 2 Opentracing contributions:
* The JDBC contrib, that intercepts and trace all the calls to the DB
* The Spring-Boot contrib, which intercepts and trace all incoming HTTP calls
We are using the [opentracing contributions](https://github.com/opentracing-contrib) in order to trace:
* All the JDBC queries and calls to the DB
* All incoming HTTP calls


The instrumentation is injected via the Datadog Java Agent. Java agents allows developers to execute
some code before starting the legacy application. All operations for instrumenting the code are done
at this time.

Each contribution hides the complexity to the developers.

### Run the demo

The demo consistes into a very simple backend backed by a MySQL db. The Spring Boot application exposes
2 endpoints that can be reached via an HTTP request.

#### Prerequisites
1. Please make sure that you read and executed the prerequisites provided [on this page](../../../raclette-java-examples/README.md)
2. Make also sure that you have a MySQL DB running (and an access to it). Then [Update your settings here](src/main/resources/application.properties).
1. Run the latest version of Datadog Agent. For instance, you can run it through a docker container:
`docker run -d --name dd-agent -v /var/run/docker.sock:/var/run/docker.sock:ro -v /proc/:/host/proc/:ro -v /sys/fs/cgroup/:/host/sys/fs/cgroup:ro -e API_KEY=<YOUR-API-KEY> -e SD_BACKEND=docker -p 8126:8126 -P datadog/docker-dd-agent:latest`
2. Run an instance of MyQSL. This could also be done using docker:
`docker run -dt --name mysql -e MYSQL_ROOT_PASSWORD=root -p 3306:3306 -e MYSQL_DATABASE=springdb mysql`

#### Run the application

If you want to enable tracing you have to launch the application with the datadog java agent.
The first step is to edit the Spring configuration file and the Datadog Tracer file and check if the
connection properties are okay.

```properties
# file: src/resources/application.properties

spring.datasource.driver-class-name= io.opentracing.contrib.jdbc.TracingDriver
spring.datasource.url= jdbc:tracing:mysql://localhost:3306/springdb
spring.datasource.username=root
spring.datasource.password=root
```

```yaml
# file: src/resources/dd-trace.yaml

# Service name used if none is provided in the app
defaultServiceName: spring-app

# The writer to use.
writer:
type: DDAgentWriter
host: localhost
port: 8126

# The sampler to use.
sampler:
type: AllSampler
```

Then, is to run the Spring Application along the Datadog Java Agent.

- So first download the `jar` file from the main repository.

```
# use latest version
curl -OL http://central.maven.org/maven2/com/datadoghq/dd-java-agent/{version}/dd-java-agent-{version}.jar
```

- Then add the following JVM argument when launching your application (in IDE, using Maven run or simply in collaboration with the `>java -jar` command):

That can be done by providing the following JVM argument (assuming the `M2_REPO` env variable is set and we run version `{version}`):
`-javaagent:${M2_REPO}/com/datadoghq/dd-java-agent/{version}/dd-java-agent-{version}.jar`.
```
-javaagent:/path/to/the/dd-java-agent-{version}.jar
```

There are 2 ways to test it:
- Finally, run the application through your IDE or Maven with the `javaagent` option.

- Either with Maven: `mvn spring-boot:run -Djavaagent:${M2_REPO}/com/datadoghq/dd-java-agent/{version}/dd-java-agent-{version}.jar`
- Or if you prefer with your IDE providing the java agent command
```
mvn spring-boot:run -Djavaagent:/path/to/the/dd-java-agent-{version}.jar
```


### Generate traces
Expand Down
197 changes: 143 additions & 54 deletions dd-trace/README.md
Original file line number Diff line number Diff line change
@@ -1,17 +1,18 @@
## Datadog Java Tracer
# Datadog Opentracing Tracer

### Motivations
## Motivations

The Datadog Java Tracer is an OpenTracing-compatible tracer. It provides all resources needed to instrument your code.
The Datadog Tracer is an [Opentracing](http://opentracing.io/) compatible tracer. It provides all resources needed to instrument your code
and report each operation and each trace directly to a Datadog APM platform.


Opentracing introduces the concept of the **span**. A span is **timed operation** representing "a bounded process" in the code.
The spans can **be linked together**. And a **trace** is a list of spans, each related to the same top action/operation.
Opentracing uses the concept of the **span**. A span is **timed operation** representing a bunch of work executed.
Spans can **be linked together**. And a **trace** is a collection of spans, related to the same top action/operation.

Let's see an example.

The workflow can be a client requesting, via a HTTP endpoint, some resources store in a DB.
Look at the following scheme.
For instance, a client requesting a resource through an HTTP endpoint.
Look at the following workflow.

````
TRACE:
Expand All @@ -31,27 +32,31 @@ As just described, the tracer produces a trace composed of 4 spans, each represe
2. Span2 is the Span1's first child, representing the amount of time to understand the query, and perform the query
on the DB.
3. Span3, a Span1' grandchild, represents the DB time used to retrieve the data
4. Span4 is a child of Span2 and followed Span3. It represents a business process for instance.
4. Span4 is a child of Span2 and followed Span3. It represents a business/legacy operation.

This is a very simple example of how works [Opentracing](http://opentracing.io/).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"example of how Opentracing works"

Do not hesitate to go deeper and read the full documentation: http://opentracing.io/
To dig deeper, read the full documentation: http://opentracing.io/


### How to instrument well-known framework?
## How to instrument your application?

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Before this advanced section, we should provide a "Quick start guide" where we put the strict minimum to have it running (just the java agent) + say to have the Agent running. With the config defaults, that should just work.

Similar examples for other languages: https://app.datadoghq.com/apm/install


Datadog instruments many frameworks and libraries by default: SpringBoot, JDBC, Mongo, JMS, Tomcat, etc.
Check the dedicated project and agent: [dd-java-agent](../dd-java-agent)
In order to start to instrument your application, you need to:

1. [Configure the Datadog Tracer](#config)

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That should be 2. instead of 1.: first you instrument your app, then you may need to tweak the config (but most of the time you won't right away).

2. Choose one of the 3 ways to instrument an application:

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Imho, we should not oppose these 3 ways (not "choose one"), but instead offer them all together. ie. we should word it as successive steps:

  • Run the auto tracing agent
  • Extend it with your own instrumentation (then in this section we document the Tracer/Span/annotation API).

1. [Use the autotracing agent for supported frawemorks](#framework)
2. [Use the Opentracing API](#api)
3. [Use annotations](#annotation)

### How the Datadog Tracer (DDTrace) is loaded in the project?
### <a name="config"></a> Datadog Tracer configuration

This current implementation uses the trace-resolver feature provides by Opentracing.
That means you can add and load the tracer using a Java Agent directly with the JVM.

The DDTrace is autoconfigured using the YAML file provided in the project: `dd-trace.yaml`.
By default, the DDTrace tries to reach a local Datadog Agent, but you can change the settings and use a different
The DDTracer is auto-configured using this YAML file.

By default, the DDTracer tries to reach a local Datadog Agent, but you can change the settings and use a different
location. In order to do that, please, refer you to the latest configuration: [dd-trace.yaml](src/main/resources/dd-trace.yaml)

*Make sure that file is present in your classpath*.

```yaml
# Service name used if none is provided in the app
defaultServiceName: unnamed-java-app
Expand All @@ -76,78 +81,162 @@ sampler:
type: AllSampler
```

To attach the agent to the JVM, you simply have to declare the provided `jar` file in your
JVM arguments as a valid `-javaagent:`. We assume that your `${M2_REPO}` env variable is properly set.
Don't forget to replace the `{version}` placeholder in the following commands.

### <a name="framework"></a>Use the Datadog Java agent for well-known framework

So first download the `jar` file from the main Maven repository:
Datadog uses instrumentation contributed by [the community](https://github.com/opentracing-contrib) to instrument many frameworks:
SpringBoot, JDBC, Mongo, JMS, Tomcat, etc. By using the Datadog Java agent, you just need to follow few steps in order to get traces.


Get the latest version of the Datadog Java agent (Do not forget to replace the version `${version}` by the appropriate one).

```bash
version=0.1.1
curl -OL http://central.maven.org/maven2/com/datadoghq/dd-java-agent/${version}/dd-java-agent-${version}.jar
```
> mvn dependency:get -Dartifact=io.opentracing-contrib:opentracing-agent:${version}
```
Then add the following JVM argument when launching your application (in IDE, using Maven run or simply in collaboration with the `>java -jar` command):
Then, attach the Java agent to your JVM using th `javaagent` option.

```
-javaagent:${M2_REPO}/io/opentracing-contrib/opentracing-agent/${version}/opentracing-agent-${version}.jar
```bash
java -javaagent:/path/to/dd-java-agent-${version}.jar ...
```

If you have a local Datadog agent running on your host, traces are visible in your Datadog account.

At this point, the DDTrace is loaded in the project. Let's see now how to instrument it.

### How to use the Datadog Tracer (DDTrace) for instrumenting legacy code?
You can choose which framework you want to instrument, or sending traces to a remote Datadog agent by configuring the Datadog Java Agent YAML file.
Check the dedicated project for the full documentation: [dd-java-agent](../dd-java-agent)

Once, the DDTrace is loaded, you can start to instrument your code using the Opentracing SDK or the `@Trace` annotation.
`@Trace` is actually a Datadog specific, but we plan to submit it to Opentracing foundation.

To use them, you have to add the dependency to the DDTrace.
Just edit you `pom.xml` and add this:
### <a name="api"></a>Custom instrumentations using Opentracing API

```xml
<dependency>
<groupId>com.datadoghq</groupId>
<artifactId>dd-trace</artifactId>
<version>${dd-trace-java.version}</version>
</dependency>
```
If you want to add custom instrumenting to your code, you have to use the Opentracing API.
The official documentation can be found right here: [](https://github.com/opentracing/opentracing-java).

Let's look at a simple example.

You can start as shown below, here is an example how to use both of them to instrument 2 simple methods.

```java
class InstrumentedClass {


@Trace
void methodAnnoted() {
// The annotation will do the same thing as the manual instrumentation below
//Do some thing here ...
Thread.sleep(1_000);
}

void methodSDK() {
void method0() {
// Retrieve the tracer using the resolver provided
// Make sure you have :
// 1. added the agent to the jvm (-javaagent;/path/to/agent.jar)
// 2. a dd-trace.yaml file in your resources directory
Tracer tracer = io.opentracing.util.GlobalTracer.get();

Span span = tracer.buildSpan("operation-name").build();
Span span = tracer.buildSpan("operation-name").startActive();
new io.opentracing.tag.StringTag("service-name").set(span, "new-service-name");


//Do some thing here ...
Thread.sleep(1_000);

// Close the span, the trace will automatically reported to the writer configured
span.close();
span.finish();
}

}

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We could probably add a set of more / advanced examples in a docs directory, then link to it from there. (there, we would be able to use the entire OpenTracing API with some real examples, to which people can refer).

```

The method above is now instrumented. As you can see, the tracer is retrieved from a global registry, called `GlobalTracer`.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is more advanced, more especially if people run the Trace Agent it is not needed and might confuse them.
We could put that with other advanced examples.


The last thing you have to do is providing a configured tracer. This can be easily done by using the `TracerFactory` or manually
in the bootstrap method (like the `main`).

```java
public class Application {

public static void main(String[] args) {

// Init the tracer from the configuration file
Tracer tracer = DDTracerFactory.createFromConfigurationFile();
io.opentracing.util.GlobalTracer.register(tracer);

// Init the tracer from the API
Writer writer = new com.datadoghq.trace.writer.DDAgentWriter();
Sampler sampler = new com.datadoghq.trace.sampling.AllSampler();
Tracer tracer = new com.datadoghq.trace.DDTracer(writer, sampler);
io.opentracing.util.GlobalTracer.register(tracer);

// ...
}
}
```

If you have a running Datadog Agent with the [APM feature enabled](http://docs.datadoghq.com/tracing/), you should
see traces directly to your Datadog account.
The factory looks for a `dd-trace.yaml` file in the classpath.

Finally, do not forget to add the corresponding dependencies to your project.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe we should start with that?



```
<!-- Opentracing API -->
<dependency>
<groupId>io.opentracing</groupId>
<artifactId>opentracing-api</artifactId>
<version>${opentracing.version}</version>
</dependency>

<!-- Datadog Tracer (only needed if you do not use the Datadog autotracing agent) -->
<dependency>
<groupId>com.datadoghq</groupId>
<artifactId>dd-trace</artifactId>
<version>${dd-trace-java.version}</version>
</dependency>

compile group: 'io.opentracing', name: 'opentracing-api', version: '${opentracing.version}'
compile group: 'com.datadoghq', name: 'dd-trace', version: '${dd-trace-java.version}'

```


### <a name="annotation"></a>Custom instrumentations using Annotation

Datadog provides a third way to instrument your code: annotations.
The following example is the same as above. Just add `@Trace` to the methods you want to instrument.

```java
class InstrumentedClass {

@Trace(operationName = "operation-name-1")
void method1() {

//Do some thing here ...
Thread.sleep(1_000);
}

@Trace(operationName = "operation-name-2")
void method2() {

// You can get the current span and add tag as follow
Span current = io.opentracing.util.GlobalTracer.get().activeSpan();
new io.opentracing.tag.StringTag("service-name").set(current, "new-service-name");

//Do some thing here ...
Thread.sleep(1_000);
}
}
```

In order to use annotations, the only required dependency is that package.
```
<!-- Datadog annotations -->
<dependency>
<groupId>com.datadoghq</groupId>
<artifactId>dd-trace-annotations</artifactId>
<version>${dd-trace-java.version}</version>
</dependency>

compile group: 'com.datadoghq', name: 'dd-trace-annotations', version: '${dd-trace-java.version}'
```
The annotations are resolved at the runtime by the Datadog Java agent. If you want to use the annotations,
so you must run the Datadog Java Agent.

To run the agent, please refer to the Datadog Java agent documentation: [dd-java-agent](../dd-java-agent)


### Other useful resources
## Other useful resources

Before instrumenting your own project you might want to run the provided examples:

Expand Down
Loading