Functional Tests 401

Hi,

I followed your guide about setting up the test environment and writting functional tests. I am stuck on my very first testIndex action because I get 401 (authentication failure) where I am expecting 200.

I did:

configured config_test.yml

app/console oro:install --env test --organization-name Oro --user-name admin --user-email admin@example.com --user-firstname John --user-lastname Doe --user-password admin --sample-data n --application-url http://localhost --force

1	app/console oro:install --env test --organization-name Oro --user-name admin --user-email admin@example.com --user-firstname John --user-lastname Doe --user-password admin --sample-data n --application-url http://localhost --force

app/console doctrine:fixture:load --no-debug --append --no-interaction --env=test --fixtures ./vendor/oro/platform/src/Oro/Bundle/TestFrameworkBundle/Fixtures

1	app/console doctrine:fixture:load --no-debug --append --no-interaction --env=test --fixtures ./vendor/oro/platform/src/Oro/Bundle/TestFrameworkBundle/Fixtures

app/console oro:test:schema:update --env test

1	app/console oro:test:schema:update --env test

I see my db populated and user exists with username “admin”

and this my my test:

<?php namespace Mekit\Bundle\AccountBundle\Tests\Functional\Controller; use Oro\Bundle\TestFrameworkBundle\Test\WebTestCase; /** * @outputBuffering enabled * @dbIsolation */ class AccountControllerTest extends WebTestCase { protected function setUp() { $this->initClient( [], array_merge($this->generateBasicAuthHeader(), array('HTTP_X-CSRF-Header' => 1)) ); } public function testIndexAction() { $this->client->request('GET', $this->getUrl('mekit_account_index')); $result = $this->client->getResponse(); $this->assertHtmlResponseStatusCodeEquals($result, 200); $this->assertContains('Account', $result->getContent()); } }

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26

<?php namespace Mekit\Bundle\AccountBundle\Tests\Functional\Controller;   use Oro\Bundle\TestFrameworkBundle\Test\WebTestCase;   /** * @outputBuffering enabled * @dbIsolation */ class AccountControllerTest extends WebTestCase {   protected function setUp() { $this->initClient( [], array_merge($this->generateBasicAuthHeader(), array('HTTP_X-CSRF-Header' => 1)) ); }   public function testIndexAction() { $this->client->request('GET', $this->getUrl('mekit_account_index')); $result = $this->client->getResponse(); $this->assertHtmlResponseStatusCodeEquals($result, 200); $this->assertContains('Account', $result->getContent()); } }

… and this is what i get:

Failed asserting that 401 matches expected 200. Expected :200 Actual :401

1 2 3

Failed asserting that 401 matches expected 200. Expected :200 Actual   :401

:-(

I even tried without luck:

protected function setUp() { $this->initClient( [], array_merge($this->generateBasicAuthHeader("admin", "admin"), array('HTTP_X-CSRF-Header' => 1)) ); }

1 2 3 4 5 6

protected function setUp() { $this->initClient( [], array_merge($this->generateBasicAuthHeader("admin", "admin"), array('HTTP_X-CSRF-Header' => 1)) ); }

Where do you think I made a mistake out something?

---

oro/platform(1.6.2) + oro/doctrine-extensions(1.0.7) + symfony/symfony(v2.3.27)

Topic

[jakabadambalazsParticipant]

I am on oro/platform 1.6.0 (composer installed)

in CLI I have Zend OPcache disabled:
Opcode Caching => Disabled
Optimization => Disabled
Startup Failed => Opcode Caching is disabled for CLI

Did fresh install on newly created db. No cookies! 401!
same error

---

oro/platform(1.6.2) + oro/doctrine-extensions(1.0.7) + symfony/symfony(v2.3.27)

[Yevhen ShyshkinParticipant]

(wall)

401 with error “Property Oro\Bundle\UserBundle\Entity\User::$avatar does not exist”?

[jakabadambalazsParticipant]

After narly 24hrs of trying to make this work I did something really ugly (not a solution) but I wanted to see if this was the only error I have or if I can expect others.

I brutally pasted:

protected $avatar; public function setAvatar($value) { $this->avatar = $value; return $this; } public function getAvatar() { return $this->avatar; }

1 2 3 4 5 6 7 8 9 10 11

protected $avatar;     public function setAvatar($value)     {         $this->avatar = $value; return $this;     }     public function getAvatar()     {         return $this->avatar;     }

inside Oro/Bundle/UserBundle/Entity/User

you know what? I get 200 and all the test pass!!!

so this is the only error – for some reason however I cannot get my head around it

it is as if the extendEntity properties and methods were not present – I tried and the class does get loaded but there is something fishy…

---

oro/platform(1.6.2) + oro/doctrine-extensions(1.0.7) + symfony/symfony(v2.3.27)

[Yevhen ShyshkinParticipant]

Thank you so much for reporting!!!
I’ll create new bug for that – we’ll fix it.

[jakabadambalazsParticipant]

No, thanks to you!

Just for reference:

{ "name": "oro/platform", "version": "1.6.0", "source": { "type": "git", "url": "https://github.com/orocrm/platform.git", "reference": "66565d741b4b1db0ea792c61bce1cb22d6e75e88" }, "dist": { "type": "zip", "url": "https://api.github.com/repos/orocrm/platform/zipball/66565d741b4b1db0ea792c61bce1cb22d6e75e88", "reference": "66565d741b4b1db0ea792c61bce1cb22d6e75e88", "shasum": "" }, ...

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16

{             "name": "oro/platform",             "version": "1.6.0",             "source": {                 "type": "git",                 "url": "https://github.com/orocrm/platform.git",                 "reference": "66565d741b4b1db0ea792c61bce1cb22d6e75e88"             },             "dist": {                 "type": "zip",                 "url": "https://api.github.com/repos/orocrm/platform/zipball/66565d741b4b1db0ea792c61bce1cb22d6e75e88",                 "reference": "66565d741b4b1db0ea792c61bce1cb22d6e75e88",                 "shasum": ""             }, ...

---

oro/platform(1.6.2) + oro/doctrine-extensions(1.0.7) + symfony/symfony(v2.3.27)

[jakabadambalazsParticipant]

I’ll create new bug for that – we’ll fix it.

Can you create it with SUPER-HIGH priority, pls? This makes platform and anything built on platform untestable!

Thanks
a\

---

oro/platform(1.6.2) + oro/doctrine-extensions(1.0.7) + symfony/symfony(v2.3.27)

[Yevhen ShyshkinParticipant]

It’s “critical” now. Unfornunately, there is no stable steps to reproduce for this bug (on our CI and local env there are no errors), so it might take some time.

[jakabadambalazsParticipant]

How is that possible? Do you mean that this might be something related to my dev environment?

I’ll make a new deployment and try to reproduce the problem and document the steps.

---

oro/platform(1.6.2) + oro/doctrine-extensions(1.0.7) + symfony/symfony(v2.3.27)

[Yevhen ShyshkinParticipant]

I believe that’s combination of environment (php, optcache, maybe something else) + cache + installation. We randomly faced this issue, but we thought it’s fixed.

[jakabadambalazsParticipant]

I have just checked out the platform @ commit 66565d741b4b1db0ea792c61bce1cb22d6e75e88 (1.6 stable) and as you said all tests are green!

My other project based on the same commit (same apache/php platform and same config has the above problems). Even though I don’t really fancy doing this I’ll try to confront the two deployments – maybe I can find what is wrong.

If I have unwantedly modified some of the files in the OroPlatform composer should tell me I did, right? well, this does not happen.

So I am thinking about some difference in the config files under app/config that I might have changed.
I really don’t know at this point.
I’ll let you know if I have found something and if it is a real bug or not.

Thanks for assisting me @yshyshkin!

a\

---

oro/platform(1.6.2) + oro/doctrine-extensions(1.0.7) + symfony/symfony(v2.3.27)

[jakabadambalazsParticipant]

Good news and Bad news! (good for you and bad for me);)

I have tried them all! At the end, given that functional tests on oroPlatform by itself do work but on the deployment with my bundles (with same OroPlatform and identical vendors folder) fail the functional tests I started to think that there was something in my code causing the problem. (actually, this is where I should have started)

In fact, if I remove the entire src folder where my codebase is, the oroPlatform functional tests work!

So this leaves us with:

1) You can remove the critical bug because whatever it is – it is not related to your code – the bug is not yours but mine.

2) Now, one by one I’ll put back my bundles and I’ll try to track down which bundle/class/entity/whatever causes this havoc

I’ll keep you posted
a\

---

oro/platform(1.6.2) + oro/doctrine-extensions(1.0.7) + symfony/symfony(v2.3.27)

[jakabadambalazsParticipant]

Dear @yshyshkin – sorry that I am making you crazy about this stuff but I really want to make functional tests work.

This is the current situation:
1) clear oroBundle 1.6 stable
2) one own bundle to test testing – no entities, simple controller with:
/**
* @Route(
* "/{_format}",
* name="mekit_playground_index",
* requirements={"_format"="html|json"},
* defaults={"_format" = "html"}
* )
* @Template
* @return array
*/
public function indexAction() {
$data = [
'dumpdata' => 'Nothing here'
];
return $data;
}


3) and in twig I have:

{% extends 'OroUIBundle:actions:index.html.twig' %} {% import 'OroUIBundle::macros.html.twig' as UI %} {% set pageTitle = 'PLAYGROUND' %} {% block content_datagrid %} <p class="environment">Application Environment: {{ app.environment }}</p> <pre>{{ dump(dumpdata) }}</pre> {% endblock content_datagrid %}

1 2 3 4 5 6 7 8 9 10

{% extends 'OroUIBundle:actions:index.html.twig' %} {% import 'OroUIBundle::macros.html.twig' as UI %} {% set pageTitle = 'PLAYGROUND' %}   {% block content_datagrid %} <p class="environment">Application Environment: {{ app.environment }}</p> <pre>{{ dump(dumpdata) }}</pre> {% endblock content_datagrid %}

When I test this route with:
public function testIndexAction() {
$crawler = $this->client->request('GET', $this->getUrl('mekit_playground_index',[]));
//$request = $this->client->getRequest();
$result = $this->client->getResponse();
$resCode = $result->getStatusCode();

echo "\n\nRESULT($resCode): ";
if(!$result->isOk()) {
$exception = $crawler->filter('div.text-exception')->extract(['_text']);
print_r($exception);
} else {
$exception = $crawler->filter('p.environment')->extract(['_text']);
print_r($exception);
}
}


I get 500! This is a real move forward!!!

The exception I get is:

The function “dump” does not exist in /home/jack/domains/master.mekitcrm.bradipo/MekitCrmApplication/src/Mekit/Bundle/PlaygroundBundle/Resources/views/Playground/index.html.twig at line 7

So I checked on this and in my config_test.yml i have

services: twig.extension.debug: class: Twig_Extensions_Extension_Debug tags: - { name: twig.extension }

1 2 3 4 5 6

services:     twig.extension.debug:         class: Twig_Extensions_Extension_Debug         tags:             - { name: twig.extension }

looking on some sf2 blogs I noticed that people suggest to use the class “Twig_Extension_Debug”

so modifying the above yml to:

services: twig.extensions.extension.debug: class: Twig_Extensions_Extension_Debug tags: - { name: twig.extension } twig.extension.debug: class: Twig_Extension_Debug tags: - { name: twig.extension }

1 2 3 4 5 6 7 8 9 10 11

services:     twig.extensions.extension.debug:         class: Twig_Extensions_Extension_Debug         tags:             - { name: twig.extension }     twig.extension.debug:         class: Twig_Extension_Debug         tags:             - { name: twig.extension }

I get green lights!!! 200!!! OK!

So what is this Twig_Extensions_Extension_Debug class for and why do we not have the debug function in test environment (as we do in dev)?

---

oro/platform(1.6.2) + oro/doctrine-extensions(1.0.7) + symfony/symfony(v2.3.27)

[Yevhen ShyshkinParticipant]

> what is this Twig_Extensions_Extension_Debug class
It adds debug tag (not function) – e.g. {% debug var %} instead of {{ debug(var) }}.

> why do we not have the debug function in test environment (as we do in dev)?
Because test env for functinal tests should be similar to prod as much as possible.

In fact both expressions can be used, it’s up to you to decide – that’s what config*.yml files is used for.

[jakabadambalazsParticipant]

THIS IS CRAZY! You won’t believe this!!!

This is my phpunit.xml file in the project root:

<?xml version="1.0" encoding="UTF-8"?> <phpunit backupGlobals = "false" backupStaticAttributes = "false" colors = "false" convertErrorsToExceptions = "true" convertNoticesToExceptions = "true" convertWarningsToExceptions = "true" processIsolation = "false" stopOnFailure = "false" syntaxCheck = "false" bootstrap ="src/Mekit/Bundle/TestBundle/phpunitBootstrap/bootstrap.php" > <testsuites> <testsuite name="MekitCRM Unit Test Suite"> <directory suffix="Test.php">src/Mekit/Bundle/*Bundle/Tests/Unit</directory> </testsuite> <testsuite name="MekitCRM Functional Test Suite"> <directory suffix="Test.php">src/Mekit/Bundle/*Bundle/Tests/Functional</directory> </testsuite> </testsuites> <php> <server name="KERNEL_DIR" value="app" /> </php> <!--<logging>--> <!--<log type="coverage-text" target="php://stdout" showUncoveredFiles="false"/>--> <!--</logging>--> <filter> <whitelist> <directory suffix=".php">src</directory> <exclude> <directory>vendor</directory> <directory>src/Mekit/Bundle/*Bundle/Tests</directory> <directory>src/Mekit/Bundle/*Bundle/Resources</directory> <directory>src/Mekit/Bundle/*Bundle/DataFixtures</directory> <directory>src/Mekit/Bundle/*Bundle/vendor</directory> </exclude> </whitelist> </filter> </phpunit>

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47

<?xml version="1.0" encoding="UTF-8"?> <phpunit         backupGlobals               = "false"         backupStaticAttributes      = "false"         colors                      = "false"         convertErrorsToExceptions   = "true"         convertNoticesToExceptions  = "true"         convertWarningsToExceptions = "true"         processIsolation            = "false"         stopOnFailure               = "false"         syntaxCheck                 = "false"         bootstrap                   ="src/Mekit/Bundle/TestBundle/phpunitBootstrap/bootstrap.php"         >       <testsuites>         <testsuite name="MekitCRM Unit Test Suite">             <directory suffix="Test.php">src/Mekit/Bundle/*Bundle/Tests/Unit</directory>         </testsuite>         <testsuite name="MekitCRM Functional Test Suite">             <directory suffix="Test.php">src/Mekit/Bundle/*Bundle/Tests/Functional</directory>         </testsuite>     </testsuites>       <php>         <server name="KERNEL_DIR" value="app" />     </php>       <!--<logging>-->         <!--<log type="coverage-text" target="php://stdout" showUncoveredFiles="false"/>-->     <!--</logging>-->       <filter>         <whitelist>             <directory suffix=".php">src</directory>             <exclude>                 <directory>vendor</directory>                 <directory>src/Mekit/Bundle/*Bundle/Tests</directory>                 <directory>src/Mekit/Bundle/*Bundle/Resources</directory>                 <directory>src/Mekit/Bundle/*Bundle/DataFixtures</directory>                 <directory>src/Mekit/Bundle/*Bundle/vendor</directory>             </exclude>         </whitelist>     </filter>   </phpunit>

As you can see I have divided the test suites into Unit and Functional.

If I remove the “MekitCRM Functional Test Suite” testsuite block, the unit test run and I get OK.

If I remove the “MekitCRM Unit Test Suite” testsuite block, the functional tests run and I get OK.

If I leave in both, my functional tests fail and I get 401!!!

I have, since the very beginning, had this file like this – it’s been nearly 2 weeks I am trying to make this work, I have double checked and debugged nearly all files involved in this – just to realize that there is nothing wrong with neither oroPlatform neither with my code!!!

Do you know why this happens?
a\

---

oro/platform(1.6.2) + oro/doctrine-extensions(1.0.7) + symfony/symfony(v2.3.27)

[Yevhen ShyshkinParticipant]

Somehow tests affects testing environment, i.e. tests are not completely isolated. Need to find a difference between these environments and check what exactly triggers this error.

IMHO, these test sutes should be executed in differenct testsuites because they have different responsibilities.

[Author]

Replies