I found a solution. It seems like route groups work really well for my situation.
It's good to know that homepage of your project can be put in group, and pages.tsx files of page-folder and page-folder/[id] can also be in different groups
app
-(main) -> MainLayout
--stories
--create
--profile
--page.tsx (Homepage)
-sign-up -> No layout
-sign-in -> No layout
-stories/[id] -> StoryLayout