Skip to content

cmd/compile: prevent pointer shaping of array pointer shape types#78661

Open
alexandre-daubois wants to merge 1 commit intogolang:masterfrom
alexandre-daubois:gh-78297
Open

cmd/compile: prevent pointer shaping of array pointer shape types#78661
alexandre-daubois wants to merge 1 commit intogolang:masterfrom
alexandre-daubois:gh-78297

Conversation

@alexandre-daubois
Copy link
Copy Markdown
Contributor

@alexandre-daubois alexandre-daubois commented Apr 12, 2026

CL 704095 added an exception in shapify to prevent pointer shaping of
*[]go.shape.T, which would lose the original type by converting it to
*go.shape.uint8.

However, there is another edge case when the type argument is itself
already a shape type (e.g., go.shape.*[1]uint8). This happens when a
shaped pointer type from an outer generic function is used to
instantiate an inner generic function with a basic interface constraint.
In this case, pointer shaping converts go.shape.*[1]uint8 to
go.shape.*uint8, losing the array element type. Subsequent slice
operations then fail with "bad ptr to array in slice" because uint8 is
not an array type.

This commit adds an exception to skip pointer shaping when the type
argument is a pointer shape type whose element is an array, preserving
the array type information needed for slice operations.

Fixes #78297

@gopherbot
Copy link
Copy Markdown
Contributor

This PR (HEAD: 1ec8441) has been imported to Gerrit for code review.

Please visit Gerrit at https://go-review.googlesource.com/c/go/+/765820.

Important tips:

  • Don't comment on this PR. All discussion takes place in Gerrit.
  • You need a Gmail or other Google account to log in to Gerrit.
  • To change your code in response to feedback:
    • Push a new commit to the branch used by your GitHub PR.
    • A new "patch set" will then appear in Gerrit.
    • Respond to each comment by marking as Done in Gerrit if implemented as suggested. You can alternatively write a reply.
    • Critical: you must click the blue Reply button near the top to publish your Gerrit responses.
    • Multiple commits in the PR will be squashed by GerritBot.
  • The title and description of the GitHub PR are used to construct the final commit message.
    • Edit these as needed via the GitHub web interface (not via Gerrit or git).
    • You should word wrap the PR description at ~76 characters unless you need longer lines (e.g., for tables or URLs).
  • See the Sending a change via GitHub and Reviews sections of the Contribution Guide as well as the FAQ for details.

@gopherbot
Copy link
Copy Markdown
Contributor

Message from Gopher Robot:

Patch Set 1:

(1 comment)


Please don’t reply on this GitHub thread. Visit golang.org/cl/765820.
After addressing review feedback, remember to publish your drafts!

@gopherbot
Copy link
Copy Markdown
Contributor

Message from Alexandre Daubois:

Patch Set 1:

(1 comment)


Please don’t reply on this GitHub thread. Visit golang.org/cl/765820.
After addressing review feedback, remember to publish your drafts!

@gopherbot
Copy link
Copy Markdown
Contributor

Message from Cuong Manh Le:

Patch Set 2: Hold+1

(1 comment)


Please don’t reply on this GitHub thread. Visit golang.org/cl/765820.
After addressing review feedback, remember to publish your drafts!

CL 704095 added an exception in shapify to prevent pointer shaping of
`*[]go.shape.T`, which would lose the original type by converting it to
`*go.shape.uint8`.

However, there is another edge case when the type argument is itself
already a shape type (e.g., go.shape.*[1]uint8). This happens when a
shaped pointer type from an outer generic function is used to
instantiate an inner generic function with a basic interface constraint.
In this case, pointer shaping converts `go.shape.*[1]uint8` to
`go.shape.*uint8`, losing the array element type. Subsequent slice
operations then fail with "bad ptr to array in slice" because uint8 is
not an array type.

This commit adds an exception to skip pointer shaping when the type
argument is a pointer shape type whose element is an array, preserving
the array type information needed for slice operations.

Fixes golang#78297
@alexandre-daubois alexandre-daubois changed the title cmd/compile: prevent pointer shaping of shape types in shapify cmd/compile: prevent pointer shaping of array pointer shape types Apr 12, 2026
@gopherbot
Copy link
Copy Markdown
Contributor

Message from Alexandre Daubois:

Patch Set 2:

(1 comment)


Please don’t reply on this GitHub thread. Visit golang.org/cl/765820.
After addressing review feedback, remember to publish your drafts!

@gopherbot
Copy link
Copy Markdown
Contributor

This PR (HEAD: fa4dada) has been imported to Gerrit for code review.

Please visit Gerrit at https://go-review.googlesource.com/c/go/+/765820.

Important tips:

  • Don't comment on this PR. All discussion takes place in Gerrit.
  • You need a Gmail or other Google account to log in to Gerrit.
  • To change your code in response to feedback:
    • Push a new commit to the branch used by your GitHub PR.
    • A new "patch set" will then appear in Gerrit.
    • Respond to each comment by marking as Done in Gerrit if implemented as suggested. You can alternatively write a reply.
    • Critical: you must click the blue Reply button near the top to publish your Gerrit responses.
    • Multiple commits in the PR will be squashed by GerritBot.
  • The title and description of the GitHub PR are used to construct the final commit message.
    • Edit these as needed via the GitHub web interface (not via Gerrit or git).
    • You should word wrap the PR description at ~76 characters unless you need longer lines (e.g., for tables or URLs).
  • See the Sending a change via GitHub and Reviews sections of the Contribution Guide as well as the FAQ for details.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

cmd/compile: internal compiler error: bad ptr to array in slice go.shape.*uint8

2 participants