Skip to content

Flaky fixture causing *occasional* test failure #639

Open
@ulfaslak

Description

So I noticed this while working on #628.

I was getting a failing test here. An assertion in test_new_data_predict_method raised an exception. It compares the mean of a fixture toy_y with the 2.5% quantile of the posterior predictive mean, and it failed. I then went to check the fixture toy_y and saw that it is a random integer sequence. Since it is random (with no seed) I just reran the test action and it passed.

That's probably not the behavior we want.

My suggestion is we just seed the RNG so it behaves deterministically, but just want @wd60622 s opinion on this before I make a PR for the change.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

Labels

bugSomething isn't workingduplicateThis issue or pull request already existsmaintenancetests

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions