Skip to content

Mismatch in stability attributes error in wit-parser when using Unstable attribute in wit #1995

Closed

Description

@jsturtevant

When a new interface is marked as @unstable (feature = somefeaturegate) and it uses a stable type from another package via use package:interface/type.{name} the resulting package can't be imported into other packages that use it. The resulting error is:

wasm-tools component wit --features tls ./wit/
error: mismatch in stability attributes

example

I've demonstrated this by adding a test: jsturtevant@4495325

As well as trying to integrate it into another world: https://github.com/WebAssembly/wasi-cli/compare/main...jsturtevant:wasi-cli:wasi-tls-example?expand=1 (note that this was just a test to see if I was getting in the a set up similiar to other imports)

I was getting this original from wit-bindgen macro: https://github.com/bytecodealliance/wit-bindgen/tree/main?tab=readme-ov-file#supported-guest-languages

workaround

for now I've patched wit-parser like jsturtevant@22cfe2e but it seems like there is probably a better way to approach?

Activity

  1. alexcrichton commented on Feb 6, 2025

    @alexcrichton
    Member

    Thanks for the report! I'm traveling for a bit so may take me a bit to dig in to this but I plan on doing so in the not-too-distant future

  2. alexcrichton commented on Feb 10, 2025

    @alexcrichton
    Member

    Digging into this, can you confirm that the reduced test case you have reproduces the original error you were seeing? Locally if I revert your fix on your branch and run the test suite I see:

    failures:
    
    ---- "tests/ui/multi-package-features" ----
    test "tests/ui/multi-package-features" failed
    
    Caused by:
        0: failed to resolve directory while parsing WIT for path [tests/ui/multi-package-features]
        1: type `unstable-resource` not defined in interface
                --> tests/ui/multi-package-features/deps/unstable/root.wit:12:33
                 |
              12 |     use wasi:dep2/stable@0.2.3.{unstable-resource};
                 |                                 ^----------------
    
    
    failures:
        "tests/ui/multi-package-features"
    

    which looks different from "mismatch in stability attributes" that you were seeing with wasi-tls.

    I'm definitely seeing some funny behavior that I wouldn't expect with use and feature attributes too. The test case you have can be reduced further to:

    package wasmtime:test;
    
    interface types {
      @unstable(feature = notsure)
      use wasi:dep2/stable@0.2.3.{unstable-resource};
    }
    
    package wasi:dep2@0.2.3 {
      interface stable {
        @unstable(feature = notsure)
        resource unstable-resource;
      }
    }

    which yields:

    $ wasm-tools component wit foo.wit
    error: type `unstable-resource` not defined in interface
         --> foo.wit:5:31
          |
        5 |   use wasi:dep2/stable@0.2.3.{unstable-resource};
          |                               ^----------------
    

    and while this looks problematic it looks different from the problems you were seeing originally too

  3. alexcrichton commented on Feb 10, 2025

    @alexcrichton
    Member

    I've fixed the issue of your reduced test case (I think) as part of #2046, and it may actually end up helping the original test case, but I'd still want to confirm before closing.

  4. jsturtevant commented on Feb 13, 2025

    @jsturtevant
    ContributorAuthor

    Thanks for looking into this. I messed up when I included the unstable-resource. I was experimenting and accidentally included that in the commit.

    I am still getting an error, using your simplified example as a guide, I've reduced the failure to:

    package wasmtime:test;
    
    world test{
        include wasi:foo/imports@0.2.3;
        include wasi:unstable/imports@0.2.3; 
    } 
    
    package wasi:unstable@0.2.3 {
        @unstable(feature = active)
        world imports {
            @unstable(feature = active)
            use wasi:dep2/stable@0.2.3.{stable-resource};
        }
    }
    
    package wasi:foo@0.2.3 {
        @since(version = 0.2.0)
        world imports {
            @since(version = 0.2.0)
            include wasi:dep2/imports@0.2.3;
        }
    }
    
    package wasi:dep2@0.2.3 {
        @since(version = 0.2.0)
        world imports {
            @since(version = 0.2.0)
            import stable;
        }
        @since(version = 0.2.0)
        interface stable {
            resource stable-resource {
            }
        }
    }
    
    git last
    commit a86afae206ad5df897c3f50a06d667d19b18bb01 
    
    cargo run -- component wit --features active example.wit
    error: mismatch in stability attributes
    
  5. jsturtevant commented on Feb 13, 2025

    @jsturtevant
    ContributorAuthor

    I've fixed the issue of your reduced test case (I think) as part of #2046, and it may actually end up helping the original test case, but I'd still want to confirm before closing.

    This might have broken general features, when I run the latest tools against the wasi-cli repo with no features I get:

    git log -1 HEAD
    commit a86afae206ad5df897c3f50a06d667d19b18bb01 
    
    cargo run -- component wit ../wit/wasi-cli/wit/
        Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.22s
         Running `target/debug/wasm-tools component wit ../wit/wasi-cli/wit/`
    error: found a reference to a type which is excluded due to its feature not being activated
         --> ../wit/wasi-cli/wit/deps/sockets/network.wit:122:42
          |
      122 |     network-error-code: func(err: borrow<error>) -> option<error-code>;
    

    Where as if I checkout right before the change:

    git log -1 HEAD
    commit 823efcb9b67d36960010bafc99c73bb528bfbbbe
    
    cargo run -- component wit ../wit/wasi-cli/wit/
    // wit output successful
    
  6. alexcrichton commented on Feb 14, 2025

    @alexcrichton
    Member

    Oops, good catch! Should be fixed in #2053

  7. jsturtevant commented on Feb 18, 2025

    @jsturtevant
    ContributorAuthor

    Oops, good catch! Should be fixed in #2053

    That's working again.

    Does #1995 (comment) make sense as something that should work? This was the original issue I was running into. With a little guidance I would be happy to take a look at fixing it.

  8. alexcrichton commented on Feb 19, 2025

    @alexcrichton
    Member

    Oh dear I apologize I completely missed that comment! I'll try to dig in to that soon.

  9. alexcrichton commented on Feb 20, 2025

    @alexcrichton
    Member

    Ok I started to take a look at this and it's going to be tricky.

    What I think is happening is something like:

    • An include first includes a @since version of an interface
    • A second include includes an @unstable use statement (which elaborates to an @unstable import of the interface + use)
    • This leads to a conflict where the first include included a @since interface, and the second include included an @unstable version.

    At the very least this should have a better error, but otherwise solving this is something I'm not quite sure how to do just yet

  10. jsturtevant commented on Feb 20, 2025

    @jsturtevant
    ContributorAuthor

    That was my analysis as well. I couldn't find a great solution either so nice to hear it isn't trivial :-)

    The real world use case for this is something like taking the cli world which has wasi-sockets and adding wasi-tls (see bytecodealliance/wasmtime#10249). If we aren't able to do this then we can't ever have an unstable interface use types from other worlds when building from worlds that already use it.

    My thoughts are that if we are using a type from another world that is stable and that version already exists in the imports of the world then we should use the existing types stability. This assumes that feature is enabled and the type version being used is compatible version wise with what is already being used.

    If I understand correctly, that approach seems to be how it works in a scenario where we use the type from two stable interfaces, the type version info is merged together and is why my temp fix works

    fn update_stability(from: &Stability, into: &mut Stability) -> Result<()> {
    // If `from` is unknown or the two stability annotations are equal then
    // there's nothing to do here.
    if from == into || from.is_unknown() {
    return Ok(());
    }

  11. alexcrichton commented on Feb 22, 2025

    @alexcrichton
    Member

    I agree that the shape of the fix you describes is what we should implement, and I also definitely agree it's something we want to solve! (sorry I've been quite swamped this week so I haven't sat down to think through and write up what a full fix would be, but you've already done 90% of that now!)

    A caveat I might add is that instead of fixing update_stability, which is used in other places as well, I'd prefer to start out with something more localized such as unify_stability which is only used for include processing. Additionally instead of always taking the previous stability I think it might make sense to bias towards stable, so basically unify unstable/stable into just stable. That way it wouldn't matter what order things happen in, it'd always produce the same result.

    Would you be up for making a PR to fix this?

  12. jsturtevant commented on Feb 24, 2025

    @jsturtevant
    ContributorAuthor

    sure, localizing it to include/use makes alot of sense. I'll take a look to see what I can come up with.

  13. jsturtevant commented on Feb 25, 2025

    @jsturtevant
    ContributorAuthor

    I was playing around with this and I found there isn't really a scenario where we don't want to just use the imported type once we get to resolve_include's since by the point in processing we've already verified that everything checks out from a feature/version perspective for those features. i.e. we can't be trying to consolidate an interface type with a feature that hasn't already been resolved.

    Am I missing something? Is it nessary to upgrade the Stability for those interfaces? I was able to remove

    update_stability(astability, bstability)?;

    and all the tests still pass.

  14. alexcrichton commented on Feb 25, 2025

    @alexcrichton
    Member

    You know you're probably right, that seems like a reasonable fix as well! When first implementing this merging bits I think that fell in the bucket of "well there's two things here surely we must merge them" but I think it's reasonable to skip it in this case.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions