There's also a new blog post listing some of the difficulties and time sinks when attempting to automate interop #testing between #Fediverse applications.
https://feditest.org/blog/2024-10-24-feditest-journey-surprises/
19 posts total
There's also a new blog post listing some of the difficulties and time sinks when attempting to automate interop #testing between #Fediverse applications. https://feditest.org/blog/2024-10-24-feditest-journey-surprises/ FediTest v0.4, the test framework and test suite for the #Fediverse, was released yesterday. Lots of new stuff, check it out! To all you #developers implementing #SSRF protections in your #fediverse applications... We are all in favor of those protections. But! Have a setting that lets projects like #FediTest override it. Otherwise how can anybody test interop on anything other than on the public internet? Mastodon has a ALLOWED_PRIVATE_ADDRESSES setting, which is one way of doing it. Or just have a setting with a default value of what's disabled, and let people override it. Or whatever. But we need something ... @feditest if you're testing mitra, you can set Hey #Fediverse #developers , we are developing testing tools for the Fediverse, and are planning to run a session on FediTest at the #FediForum online conference on September 12, 13 or 14. If you are interested in interop testing your Fediverse application, join us for this session? What would you like us to talk about? Or what subjects would you like to raise? Let us know! Also, which day (Thursday, Friday or Saturday) would be best for you? FediTest version 0.3 has been released! Release notes: https://feditest.org/release-notes/0.3/ This release is mainly a maturity improvement over our first release. The Fediverse is built on open standard protocols. Testing that implementations conform to those standards is important for interoperability. That's what we are working on with the FediTest project. Here's a first draft report of Webfinger server conformance for almost 100 Fediverse applications. A total of 1615 tests were run. Overview: https://feditest.org/contrib/results/2024-06-16/ -- more details by clicking through. (cont'd...) Working on FediTest, we learned quickly that a simple pass/fail is not a very good report for many tests of Fediverse protocols. So our reporting is more complex. We distinguish not only between PASS and FAIL but PASS and a variety of non-PASS conditions. (cont'd...) "Some tentative decisions about FediTest". Blogged. Would love your feedback. Does this approach make sense to you? https://feditest.org/blog/2024-06-13-some-tentative-decisions/ #feditest #testing #fediverse #activitypub We presented the first results from FediTest this morning. 39 implementations, 13 tests each. One big matrix. Summary is here: https://feditest.org/blog/2024-06-05-early-results-webfinger/ Looking for help to tell the various projects. The call was recorded, recording will be posted soon. #testing The first matrix currently has 17 rows and 39 columns. And colors 🙂 Join us at 9am pacific in about 12 hours to hear about the first batch of test results? Details at https://fedidevs.org/ /cc @activitypubtestsuite #testing #feditest #activitypub #webfinger FediTest is progressing. Major update this week. Blog post: https://feditest.org/blog/2024-04-30-update/ Want to try the work-in-progress? https://feditest.org/docs/quickstart/ Early(est) access to work in progress on FediTest and the Fediverse test suite now available. Some thoughts on the components needed for the Fediverse Test Suite, and some of the challenges around them. A new blog post. What do we mean when we say "Fediverse Test Suite"? Blogged. https://feditest.org/blog/2024-02-06-what-is-a-test-suite-for-the-fediverse/ Hi everybody! Our project to build a Fediverse Test Suite is now officially under way. And we have a website at https://feditest.org -- it's very rudimentary at this point, and work in progress, but hey, release early and often... :-) There's no public code yet, but soon there will be, and we'll run some community meetups to show-and-tell and get your feedback. We'll announce when right through this account. |