Email or username:

Password:

Forgot your password?
19 posts total
Fediverse Test Suite

There's also a new blog post listing some of the difficulties and time sinks when attempting to automate interop #testing between #Fediverse applications.

feditest.org/blog/2024-10-24-f

Fediverse Test Suite

There are some new test reports, including system tests for:

* Running two Mastodon instances against each other
* Running Mastodon against WordPress + plugins

and even running three Mastodon instances against each other, for tests such as "if A posts, B reshares, and C gets it, and then A deletes the post, will it disappear on C" Happy to report that in case of Mastodon, it does!

Check them out: feditest.org/contrib/results/

#Mastodon #Wordpress #ActivityPub #Fediverse #testing

There are some new test reports, including system tests for:

* Running two Mastodon instances against each other
* Running Mastodon against WordPress + plugins

and even running three Mastodon instances against each other, for tests such as "if A posts, B reshares, and C gets it, and then A deletes the post, will it disappear on C" Happy to report that in case of Mastodon, it does!

Fediverse Test Suite

FediTest v0.4, the test framework and test suite for the #Fediverse, was released yesterday. Lots of new stuff, check it out!

feditest.org/release-notes/0.4

Fediverse Test Suite

At #SeaGL, the Seattle GNU/Linux conference, @j12t will give a talk about #FediTest on Saturday, November 8, at 9:00am.

Come by if you want to discuss how to test complex systems with complex protocols, like today's Fediverse. No registration is required, and it's free.

seagl.org/

Fediverse Test Suite

To all you #developers implementing #SSRF protections in your #fediverse applications...

We are all in favor of those protections. But!

Have a setting that lets projects like #FediTest override it. Otherwise how can anybody test interop on anything other than on the public internet?

Mastodon has a ALLOWED_PRIVATE_ADDRESSES setting, which is one way of doing it. Or just have a setting with a default value of what's disabled, and let people override it. Or whatever.

But we need something ...

silverpill

@feditest if you're testing mitra, you can set federation.ssrf_protection_enabled to false (it was added in version 3.4.0)

Fediverse Test Suite

Hey #Fediverse #developers , we are developing testing tools for the Fediverse, and are planning to run a session on FediTest at the #FediForum online conference on September 12, 13 or 14.

If you are interested in interop testing your Fediverse application, join us for this session? What would you like us to talk about? Or what subjects would you like to raise? Let us know!

Also, which day (Thursday, Friday or Saturday) would be best for you?

fediforum.org feditest.org

Fediverse Test Suite

FediTest version 0.3 has been released!

Release notes: feditest.org/release-notes/0.3

This release is mainly a maturity improvement over our first release.

/cc @activitypubtestsuite

Fediverse Test Suite

The Fediverse is built on open standard protocols. Testing that implementations conform to those standards is important for interoperability. That's what we are working on with the FediTest project.

Here's a first draft report of Webfinger server conformance for almost 100 Fediverse applications. A total of 1615 tests were run.

Overview: feditest.org/contrib/results/2 -- more details by clicking through.

(cont'd...)

Fediverse Test Suite

Working on FediTest, we learned quickly that a simple pass/fail is not a very good report for many tests of Fediverse protocols. So our reporting is more complex.

We distinguish not only between PASS and FAIL but PASS and a variety of non-PASS conditions.

(cont'd...)

Fediverse Test Suite

ANN: FediTest 0.2 is out. This is our first release, even if early as you can tell from the version number.

feditest is now in the python repos, so you can say "pip install feditest", and the documentation is current on feditest.org

You can currently use it to run your own WebFinger server tests similar to feditest.org/assets/2024-06-05 Obviously much more to come.

Feedback appreciated!

/cc @activitypubtestsuite #fediverse #activitypub #webfinger #testing #qa

ANN: FediTest 0.2 is out. This is our first release, even if early as you can tell from the version number.

feditest is now in the python repos, so you can say "pip install feditest", and the documentation is current on feditest.org

You can currently use it to run your own WebFinger server tests similar to feditest.org/assets/2024-06-05 Obviously much more to come.

Fediverse Test Suite

"Some tentative decisions about FediTest". Blogged.

Would love your feedback. Does this approach make sense to you?

feditest.org/blog/2024-06-13-s

#feditest #testing #fediverse #activitypub
/cc @activitypubtestsuite

Fediverse Test Suite

We presented the first results from FediTest this morning.

39 implementations, 13 tests each. One big matrix. Summary is here:

feditest.org/blog/2024-06-05-e

Looking for help to tell the various projects.

The call was recorded, recording will be posted soon. #testing

Fediverse Test Suite

The first matrix currently has 17 rows and 39 columns.

And colors 🙂

Join us at 9am pacific in about 12 hours to hear about the first batch of test results?

Details at fedidevs.org/

/cc @activitypubtestsuite #testing #feditest #activitypub #webfinger

Fediverse Test Suite

FediTest is progressing. Major update this week.

Blog post: feditest.org/blog/2024-04-30-u

Want to try the work-in-progress? feditest.org/docs/quickstart/

Fediverse Test Suite

Early(est) access to work in progress on FediTest and the Fediverse test suite now available.

More: feditest.org/blog/2024-04-09-e

Fediverse Test Suite

Some thoughts on the components needed for the Fediverse Test Suite, and some of the challenges around them.

A new blog post.

feditest.org/blog/2024-02-12-c

Fediverse Test Suite

Hi everybody!

Our project to build a Fediverse Test Suite is now officially under way.

And we have a website at feditest.org -- it's very rudimentary at this point, and work in progress, but hey, release early and often... :-)

There's no public code yet, but soon there will be, and we'll run some community meetups to show-and-tell and get your feedback. We'll announce when right through this account.

Go Up