Skip to content

Commit 77fc027

Browse files
authored
Merge pull request #37 from EladLeev/imporve-doc
Update main & Kafka doc
2 parents 70008e8 + 8e7a6cc commit 77fc027

File tree

2 files changed

+39
-1
lines changed

2 files changed

+39
-1
lines changed

docs/benchmarks/index.md

Lines changed: 38 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,15 +22,52 @@ OpenMessaging benchmarking suites are currently available for the following syst
2222
* [Apache RocketMQ](https://rocketmq.apache.org)
2323
* [Apache Pulsar](https://pulsar.incubator.apache.org)
2424
* [Apache Kafka](https://kafka.apache.org)
25+
* [RabbitMQ](https://www.rabbitmq.com/)
26+
* [NATS Streaming](https://nats.io/)
27+
* [Redis](https://redis.com/)
28+
* [Pravega](https://pravega.io/)
2529

26-
> Benchmarking suites for [RabbitMQ](https://www.rabbitmq.com) will be available soon.
2730

2831
For each platform, the benchmarking suite includes easy-to-use scripts for deploying that platform on [AlibabaCloud](https://www.alibabacloud.com/) and [Amazon Web Services](https://aws.amazon.com) (AWS) and then running benchmarks upon deployment. For end-to-end instructions, see platform-specific docs for:
2932

3033
* [Apache RocketMQ](../benchmarks/rocketmq)
3134
* [Apache Pulsar](../benchmarks/pulsar)
3235
* [Apache Kafka](../benchmarks/kafka)
3336

37+
## OpenMessaging Benchmark Framework Components
38+
The OpenMessaging Benchmark Framework contains two components - the driver, and the workers.
39+
**Driver** - The main "driver" is responsible to assign the tasks, creating the benchmark topic, creating the consumers & producers, etc. The benchmark executor.
40+
**Worker** - A benchmark worker that listens to tasks to perform them. A worker ensemble communicates over HTTP (defaults to port `8080`).
41+
42+
## Basic usage & flags
43+
### Driver
44+
```
45+
$ sudo bin/benchmark \
46+
--drivers driver-kafka/kafka-exactly-once.yaml \
47+
--workers 1.2.3.4:8080,4.5.6.7:8080 \ # or -w 1.2.3.4:8080,4.5.6.7:8080
48+
workloads/1-topic-16-partitions-1kb.yaml
49+
```
50+
| Flag | Description | Default |
51+
|----------------------|-------------------------------------------------------------------|---------|
52+
| -c / --csv | Print results from this directory to a CSV file. | N/A |
53+
| -d / --drivers | Drivers list. eg.: pulsar/pulsar.yaml,kafka/kafka.yaml | N/A |
54+
| -x / --extra | Allocate extra consumer workers when your backlog builds. | `false` |
55+
| -w / --workers | List of worker nodes. eg: http://1.2.3.4:8080,http://4.5.6.7:8080 | N/A |
56+
| -wf / --workers-file | Path to a YAML file containing the list of workers addresses. | N/A |
57+
| -h / --help | Print help message | `false` |
58+
59+
### Workers
60+
```
61+
$ sudo bin/benchmark-worker \
62+
--port 9090 \
63+
--stats-port 9091
64+
```
65+
| Flag | Description | Default |
66+
|--------------------|--------------------------|---------|
67+
| -p / --port | HTTP port to listen to. | `8080` |
68+
| -sp / --stats-port | Stats port to listen to. | `8081` |
69+
| -h / --help | Print help message | `false` |
70+
3471
## Benchmarking workloads
3572

3673
Benchmarking workloads are specified in [YAML](http://yaml.org/) configuration files that are available in the [`workloads`](workloads) directory. The table below describes each workload in terms of the following parameters:

docs/benchmarks/kafka.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -18,6 +18,7 @@ $ cd openmessaging-benchmark
1818
You'll also need to have [Maven](https://maven.apache.org/install.html) installed.
1919

2020
## Create local artifacts
21+
> The current Kafka client version is `2.8.1`. In order to downgrade it edit the `./driver-kafka/pom.xml` file.
2122
2223
Once you have the repo cloned locally, you can create all the artifacts necessary to run the benchmarks with a single Maven command:
2324

0 commit comments

Comments
 (0)