Skip to content

MFTF 2.5.0 #458

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 138 commits into from
Sep 18, 2019
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
138 commits
Select commit Hold shift + click to select a range
272fb1e
- Fix assignment of correct value for object return property
ameysar Jul 3, 2019
b1adef4
MQE-1306: Can not get actual entity data
tomreece Jul 31, 2019
9a09a90
Revert "Revert "Merge pull request #382 from magento/MQE-1600""
jilu1 Aug 5, 2019
82371b1
MQE-1600: MFTF Vault integration
jilu1 Aug 5, 2019
56f8ac0
MQE-1647: read vault token from local file system
jilu1 Jul 24, 2019
242045c
MQE-1647: read vault token from local file system
jilu1 Jul 24, 2019
7d11042
MQE-1647: read vault token from local file system
jilu1 Jul 25, 2019
3304dca
MQE-1647:  read vault token from local file system
jilu1 Jul 30, 2019
85c14a0
Merge pull request #406 from magento/MQE-1306
tomreece Aug 6, 2019
f9baa07
MQE-1647:  read vault token from local file system
jilu1 Aug 7, 2019
81dc8ec
MQE-1647:  read vault token from local file system
jilu1 Aug 8, 2019
985274f
Merge branch 'develop' into MQE-1647
jilu1 Aug 8, 2019
6c3d570
Merge pull request #410 from magento/MQE-1647
jilu1 Aug 8, 2019
3a9b868
MQE-1561: CreateData action must be able to parse Data entity which r…
okolesnyk Aug 12, 2019
124e106
MQE-1561: CreateData action must be able to parse Data entity which r…
okolesnyk Aug 12, 2019
bec1456
Merge branch 'develop' into MQE-1561
soumyau Aug 13, 2019
37ea58d
MQE-1561: CreateData action must be able to parse Data entity which r…
okolesnyk Aug 13, 2019
32967a2
MQE-1561: CreateData action must be able to parse Data entity which r…
okolesnyk Aug 13, 2019
2d4efac
Merge remote-tracking branch 'origin/master' into develop
tomreece Aug 15, 2019
a626fb8
Merge pull request #422 from magento/merge-master-into-develop
KevinBKozan Aug 15, 2019
dd2da2e
MQE-1561: CreateData action must be able to parse Data entity which r…
okolesnyk Aug 15, 2019
932c435
MQE-1373: Cannot Use Data Returned By Test Actions As Substitutable V…
soumyau Aug 19, 2019
466f92c
Merge branch 'develop' into MQE-1561
KevinBKozan Aug 19, 2019
3a73b31
Merge pull request #418 from magento/MQE-1561
KevinBKozan Aug 19, 2019
51e2410
MQE-1628: Error loading Yaml config from
KevinBKozan Aug 20, 2019
36c21d3
MQE-1373: Cannot Use Data Returned By Test Actions As Substitutable V…
soumyau Aug 20, 2019
b410499
MQE-1705: Fix PHP Notice in Unit Test
KevinBKozan Aug 20, 2019
dd35d9d
MQE-1331: MFTF Run:Test Will Run All Tests That Are Already Generated
soumyau Aug 20, 2019
b27e2a9
MQE-1582: Enable Testers To Run Skipped Tests
KevinBKozan Aug 21, 2019
9dfcefb
MQE-1582: Enable Testers To Run Skipped Tests
KevinBKozan Aug 21, 2019
a9d1917
MQE-1582: Enable Testers To Run Skipped Tests
KevinBKozan Aug 21, 2019
3409ac8
MQE-1582: Enable Testers To Run Skipped Tests
KevinBKozan Aug 21, 2019
6a1fac6
Merge branch 'develop' into MQE-1373
soumyau Aug 21, 2019
f9d5fe4
Merge pull request #424 from magento/MQE-1373
soumyau Aug 21, 2019
d4f9ac3
Merge branch 'develop' into MQE-1628
KevinBKozan Aug 22, 2019
ac1f5bf
Merge branch 'develop' into MQE-1705
KevinBKozan Aug 22, 2019
12f9596
Merge pull request #426 from magento/MQE-1705
KevinBKozan Aug 22, 2019
3496295
Merge branch 'develop' into MQE-1628
KevinBKozan Aug 22, 2019
4e259a0
Merge pull request #425 from magento/MQE-1628
KevinBKozan Aug 22, 2019
75cc720
MQE-1582: Enable Testers To Run Skipped Tests
KevinBKozan Aug 22, 2019
60fc571
MQE-1582: Enable Testers To Run Skipped Tests
KevinBKozan Aug 23, 2019
dc2c250
Merge branch 'develop' into fix-non-api-operations
jilu1 Aug 23, 2019
51fc64f
MQE-1582: Enable Testers To Run Skipped Tests
KevinBKozan Aug 23, 2019
d2010f0
MQE-1331: MFTF Run:Test Will Run All Tests That Are Already Generated
soumyau Aug 23, 2019
c37280f
Merge branch 'develop' into MQE-1582
KevinBKozan Aug 26, 2019
fecaf5b
Merge pull request #429 from magento/MQE-1582
KevinBKozan Aug 26, 2019
4f25d64
MQE-1331: MFTF Run:Test Will Run All Tests That Are Already Generated
soumyau Aug 26, 2019
b328d66
MQE-1582: Enable Testers To Run Skipped Tests
KevinBKozan Aug 26, 2019
13b7b09
Merge branch 'develop' into MQE-1331
soumyau Aug 26, 2019
49c9649
MQE-1055: [SPIKE] Audit performance issues with test generation in fr…
tomreece Aug 26, 2019
8f54cbb
Merge pull request #430 from magento/MQE-1582-Fix
KevinBKozan Aug 26, 2019
9006361
Merge branch 'develop' into MQE-1331
soumyau Aug 26, 2019
ee12a62
Merge pull request #427 from magento/MQE-1331
soumyau Aug 26, 2019
e3b1308
Merge remote-tracking branch 'mainline/develop' into fix-non-api-oper…
ameysar Aug 27, 2019
322bd6c
- Fix CR notes
ameysar Aug 27, 2019
23edff1
- Fix static tests
ameysar Aug 27, 2019
75b6b88
MQE-1514: Failure For seeCurrentUrlEquals Action Does Not Show Actual…
KevinBKozan Aug 27, 2019
c9120e0
Merge branch 'develop' into MQE-1055
tomreece Aug 27, 2019
3c7ed4b
Merge pull request #431 from magento/MQE-1055
tomreece Aug 27, 2019
4d46f9b
MQE-588: CreatedData should throw Error/Warning when undefined data i…
jilu1 Aug 27, 2019
0c8560b
- Fix CR notes
ameysar Aug 28, 2019
315616f
MQE-1703: Implicit Suite Generation for Tests
soumyau Aug 28, 2019
5ba993a
MQE-1703: Implicit Suite Generation for Tests
soumyau Aug 28, 2019
3282770
MQE-1703: Implicit Suite Generation for Tests
soumyau Aug 28, 2019
79ff347
MQE-1703: Implicit Suite Generation for Tests
soumyau Aug 28, 2019
66c5214
Merge branch 'develop' into fix-non-api-operations
jilu1 Aug 28, 2019
beec388
MQE-1514: Failure For seeCurrentUrlEquals Action Does Not Show Actual…
KevinBKozan Aug 28, 2019
0fe97bb
Merge pull request #377 from ameysar/fix-non-api-operations
jilu1 Aug 28, 2019
1a2dc67
MQE-1703: Implicit Suite Generation for Tests
soumyau Aug 28, 2019
4bbfb25
MQE-1703: Implicit Suite Generation for Tests
soumyau Aug 29, 2019
da509f2
MQE-1703: Implicit Suite Generation for Tests
soumyau Aug 29, 2019
037d8aa
MQE-1626: bin/mftf run:manifest
tomreece Aug 29, 2019
d84e20f
Merge remote-tracking branch 'origin/develop' into MQE-558
jilu1 Aug 29, 2019
300619d
MQE-1633: Add API Request To Output for MFTF API Actions
KevinBKozan Aug 29, 2019
a32145d
Merge branch 'MQE-1514' into MQE-1633+1514
KevinBKozan Aug 29, 2019
fdcda9a
MQE-1514: Failure For seeCurrentUrlEquals Action Does Not Show Actual
KevinBKozan Aug 29, 2019
f381963
MQE-1626: bin/mftf run:manifest
tomreece Aug 29, 2019
18030d3
MQE-1685: Test/Data self extension memory limit error
jilu1 Aug 30, 2019
0dd8840
MQE-1633: Add API Request To Output for MFTF API Actions
KevinBKozan Aug 30, 2019
4a055bf
MQE-1685: Test/Data self extension memory limit error
jilu1 Aug 30, 2019
fdd5ec0
MQE-1633: Add API Request To Output for MFTF API Actions
KevinBKozan Aug 30, 2019
d4a1237
MQE-588: CreatedData should throw Error/Warning when undefined data i…
jilu1 Aug 30, 2019
11e69d6
Small formatting fixes.
dobooth Sep 3, 2019
08354ca
Update reporting.md
tomreece Sep 3, 2019
04fa585
Merge pull request #442 from magento/tomreece-patch-2
tomreece Sep 3, 2019
69101ef
MQE-1626: bin/mftf run:manifest
tomreece Sep 3, 2019
0e3459a
Merge remote-tracking branch 'origin/develop' into MQE-1626
tomreece Sep 3, 2019
a448a0f
Merge branch 'develop' into MQE-1633+1514
KevinBKozan Sep 4, 2019
ad0e4aa
Merge pull request #436 from magento/MQE-1633+1514
KevinBKozan Sep 4, 2019
c2b9c25
Merge branch 'develop' into MQE-1626
tomreece Sep 4, 2019
a344d34
MQE-588: CreatedData should throw Error/Warning when undefined data i…
jilu1 Sep 4, 2019
ac49cbe
Merge pull request #437 from magento/MQE-1626
tomreece Sep 4, 2019
d8a8afe
MQE-1692: Improve makeScreenshot Action to Add Screenshot to Allure R…
tomreece Sep 4, 2019
7cce520
MQE-1692: Improve makeScreenshot Action to Add Screenshot to Allure R…
tomreece Sep 4, 2019
f353afe
MQE-1703: Implicit Suite Generation for Tests
soumyau Sep 4, 2019
25c57dc
MQE-588: CreatedData should throw Error/Warning when undefined data i…
jilu1 Sep 4, 2019
ef67fe2
Merge branch 'develop' into MQE-1685
jilu1 Sep 4, 2019
a233e32
Merge pull request #439 from magento/MQE-1685
jilu1 Sep 5, 2019
a708d46
Merge branch 'develop' into MQE-558
jilu1 Sep 5, 2019
167c7e7
Merge pull request #432 from magento/MQE-558
jilu1 Sep 5, 2019
5484697
Merge branch 'develop' into MQE-1692
tomreece Sep 5, 2019
9a91579
MQE-1729: Added document for PR #377
jilu1 Sep 5, 2019
4a519fe
MQE-1703: Implicit Suite Generation for Tests
soumyau Sep 5, 2019
5f81deb
MQE-1703: Implicit Suite Generation for Tests
soumyau Sep 5, 2019
4720af5
Merge branch 'develop' into MQE-1703
soumyau Sep 5, 2019
a915bd1
Merge pull request #434 from magento/MQE-1703
soumyau Sep 5, 2019
55c30ac
Small grammar change.
dobooth Sep 6, 2019
d5ff5f5
Merge branch 'develop' into MQE-1729
jilu1 Sep 6, 2019
4ae6a3a
Merge branch 'develop' into MQE-1692
tomreece Sep 9, 2019
3e0d666
Merge pull request #443 from magento/MQE-1692
tomreece Sep 9, 2019
bce86c4
Merge branch 'develop' into MQE-1729
KevinBKozan Sep 9, 2019
b8d09e4
Merge pull request #444 from magento/MQE-1729
KevinBKozan Sep 9, 2019
d1c1914
MQE-1753: Uncaught ArgumentCountError when running bin/mftf static-ch…
jilu1 Sep 10, 2019
7222259
MQE-1510 (#446)
KevinBKozan Sep 10, 2019
fa579d1
MQE-1755: mftf run:test Test1 Test2 does not run before/after hooks c…
soumyau Sep 10, 2019
3b84f12
MQE-1755: mftf run:test Test1 Test2 does not run before/after hooks c…
soumyau Sep 11, 2019
8597fcb
MQE-1755: mftf run:test Test1 Test2 does not run before/after hooks c…
soumyau Sep 11, 2019
f572a7a
MQE-1754: mftf generate:tests AdminLoginTest -f does not obey the -f …
jilu1 Sep 11, 2019
fb444bd
Merge pull request #447 from magento/MQE-1753
jilu1 Sep 11, 2019
319001b
MQE-1754: mftf generate:tests AdminLoginTest -f does not obey the -f …
jilu1 Sep 11, 2019
9cfeb9c
MQE-1755: mftf run:test Test1 Test2 does not run before/after hooks c…
soumyau Sep 11, 2019
6a5798e
MQE-1755: mftf run:test Test1 Test2 does not run before/after hooks c…
soumyau Sep 11, 2019
03c1f19
Removed breaking "\r\n" instances from command. (#441)
dobooth Sep 13, 2019
88030f3
Merge pull request #448 from magento/MQE-1755
soumyau Sep 13, 2019
04ff5b5
MQE-1754: mftf generate:tests AdminLoginTest -f does not obey the -f …
jilu1 Sep 13, 2019
02f073b
Merge branch 'develop' into MQE-1754
jilu1 Sep 13, 2019
55a8dda
Merge pull request #451 from magento/MQE-1754
jilu1 Sep 13, 2019
c113b9f
MQE-1743: Changelog and Composer Bump (#449)
KevinBKozan Sep 13, 2019
d97b013
MQE-1582: Enable Testers To Run Skipped Tests
KevinBKozan Sep 13, 2019
eca4dbc
Merge pull request #452 from magento/MQE-1582
KevinBKozan Sep 13, 2019
f63fac8
MQE-1765: Introduce API Endpoint and Request Headers to Allure artifacts
KevinBKozan Sep 16, 2019
93fd35d
MQE-1765: Introduce API Endpoint and Request Headers to Allure artifacts
KevinBKozan Sep 16, 2019
d3c7759
Merge pull request #454 from magento/Remove-Artifacts
KevinBKozan Sep 17, 2019
7accc4c
MQE-1671: updated CHANGELOG.md to include vault integration
jilu1 Sep 17, 2019
73fbfa5
Merge pull request #456 from magento/MQE-1671
KevinBKozan Sep 17, 2019
d58eb6b
MQE-1768: incorrect credential key for carriers_fedex_account in .cre…
jilu1 Sep 17, 2019
2c4f210
Merge pull request #457 from magento/MQE-1768
KevinBKozan Sep 17, 2019
007c83c
Merge branch 'master' into 2.5.0-RC
KevinBKozan Sep 17, 2019
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
36 changes: 36 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,42 @@
Magento Functional Testing Framework Changelog
================================================

2.5.0
-----
* Traceability
* Allure output has been enhanced to contain new test artifacts created and used per MFTF step:
* `makeScreenshot` will contain an attachment under its Allure step.
* `seeInCurrentUrl` and all other `Url` asserts now contain an attachment with the expects vs actual comparison.
* `createData` and all other `Data` actions now contain attachments with `Request Body` and `Response Body`.
* Modularity
* Added a new `mftf run:manifest` command to run testManifest files generated by `generate:tests`.
* See DevDocs for details
* `mftf generate/run:test` commands now implicitly generates the `suite` the test exists in.
* If a test exists in multiple suites, it will generate it in all suite contexts.
* `mftf run:test <testName>` will now only run the exact test provided, regardless of what is generated.
* Maintainability
* Added an `--allow-skipped` flag that allows MFTF to ignore the `<skip>` annotation. This was added to the following commands:
* `generate:test`
* `run:test`
* `run:group`
* `run:failed`
* Customizability
* `<entity>` defined in data.xml can now reference other `<entity>` directly.
* See DevDocs for details
* Added vault as an alternative credential storage.
* See DevDocs for details

### Fixes
* Fixed an issue where `grab` action variables were not substituting correctly when used as an element parameter.
* Framework will not throw a descriptive error when referencing a `$persisted.field$` that does not exist.
* MFTF test materials that `extends=""` itself will no longer cause infinite recursion.
* Fixed an issue where a test could not reference a `$data.field$` whose casing was modified by the API that it used.
* Fixed an issue with the default `functional.suite.yml` where it was incompatible with `symfony/yaml 4.0.0`.
* Improved test generation performance via class refactors (`~10%` faster).

### GitHub Issues/Pull requests:
* [#377](https://github.com/magento/magento2-functional-testing-framework/pull/377) -- Non-API operations fixes

2.4.5
-----
### Fixes
Expand Down
2 changes: 1 addition & 1 deletion bin/mftf
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ try {
try {
$application = new Symfony\Component\Console\Application();
$application->setName('Magento Functional Testing Framework CLI');
$application->setVersion('2.4.5');
$application->setVersion('2.5.0');
/** @var \Magento\FunctionalTestingFramework\Console\CommandListInterface $commandList */
$commandList = new \Magento\FunctionalTestingFramework\Console\CommandList;
foreach ($commandList->getCommands() as $command) {
Expand Down
6 changes: 4 additions & 2 deletions composer.json
Original file line number Diff line number Diff line change
Expand Up @@ -2,18 +2,20 @@
"name": "magento/magento2-functional-testing-framework",
"description": "Magento2 Functional Testing Framework",
"type": "library",
"version": "2.4.5",
"version": "2.5.0",
"license": "AGPL-3.0",
"keywords": ["magento", "automation", "functional", "testing"],
"config": {
"sort-packages": true
},
"require": {
"php": "7.0.2||7.0.4||~7.0.6||~7.1.0||~7.2.0||~7.3.0",
"allure-framework/allure-codeception": "~1.3.0",
"ext-curl": "*",
"allure-framework/allure-codeception": "~1.3.0",
"codeception/codeception": "~2.3.4 || ~2.4.0 ",
"consolidation/robo": "^1.0.0",
"csharpru/vault-php": "~3.5.3",
"csharpru/vault-php-guzzle6-transport": "^2.0",
"flow/jsonpath": ">0.2",
"fzaninotto/faker": "^1.6",
"monolog/monolog": "^1.0",
Expand Down
Loading