(评论)
(comments)

原始链接: https://news.ycombinator.com/item?id=40216057

Soundslice 是一家专门从事基于网络的乐谱渲染的公司。 它成立于十多年前,是创建“响应式”网络符号的先驱之一。 虽然 CSS 网格对于较轻的项目可能有益,但其复杂性可能不足以满足复杂的满分要求。 无论多么令人印象深刻,在 Angular 和 React 等框架兴起之前常用于 querySelector 的 CSS 选择器仍然是必不可少的。 例如,它们用于 Jest 和 E2E 测试环境。 考虑 ::first-line,而不是建议的 ::line 伪元素,它可能缺乏必要的功能。 替代方案包括使用 SVG 条纹和垂直重复。 尽管最初的想法是实现这种设计,但在处理谱号、调和时间修改时,该方法显得脆弱且具有挑战性。 干净利落地实现它,同时避免样式重叠仍然是一个挑战。 事实证明,跨不同网格对齐部件很困难。 尽管如此,生成具有多个板条的大型网格似乎是可行的。 对于更简单的使用,建议选择 CSS 替代方案,而不是 Lilypond,因为 Lilypond 因其复杂性和潜在的安全风险而闻名。 在渲染过程中模糊图像是保持用户满意度的一种流行技术。 虽然并非所有作品都需要复杂的符号处理,但响应式网络演示为手头的一半“简单”任务提供了便利。 对于那些从事音乐教育的人来说,这种方法为分享和练习练习提供了一个易于使用的解决方案。

相关文章

原文


Impressive hack — kudos from a fellow sheet music software developer!

I've spent more than 10 years now building Soundslice, which does web-based sheet music rendering. I believe we were the first to do "responsive" web notation (that part of the site launched in 2014).

Here's a tech talk I gave with a lot of details: https://www.youtube.com/watch?v=XH5EtQge_Bg

Here's an example of responsive Soundslice notation: https://www.soundslice.com/slices/zzNlc/ (in the settings, set the stave width to maximum to get "Fit to screen" for the true responsive effect)

We've got a whole suite of tools built around this, including an excellent web-based editor, rich practice functionality and a relatively new scanning feature (extracting the musical data from a photo or PDF).

I agree with other commenters here that this CSS Grid approach could be handy for lightweight projects but it likely isn't up to snuff for the incredibly subtle and complex world of full scores. With that said, I just want to stress again that this is super cool and I'm glad it exists!



Maybe the segment on engraving of Tantacruls Musescore 4 video is a good explanation of some of the things involved:

https://youtu.be/Qct6LKbneKQ?t=2005

the whole video is worth watching as well (and there are several videos on the channel focusing on the UI of notation apps, worth watching for anyone who does UI but isn't interested in music production as well)



Perhaps you noticed that the beams aren't really attached to the notes they are supposed to be beaming together.

OP doesn't show any multi-stave (i.e. "full score") example at all -- if the system could do that, it would likely have been part of the demo.

This is extremely cool technology, but it's clear that more polish would be needed before it's ready for general use.



This is extraordinary. While JavaScript is needed now, I’d encourage the author to see what needs to be added to CSS to allow a CSS-only solution, and promote it in the CSS community. For example, repeating the clef when wrapping is akin to a sticky table header, and would have more applications than only music.

Some CSS notation is wholly new to me:

> .stave > [data-pitch^="A"][data-pitch$="5"] { grid-row-start: A5; }

I’ve never seen CSS selectors with square brackets before. Apparently it’s an attribute selector: https://css-tricks.com/attribute-selectors/



These css selectors are actually fairly common I would say. They were used for querySelector a lot before Angular, React, etc. In addition in current times they are frequently used to grab elements by their data-testid either for jest tests or e2e tests.


I'd suggest a ::line pseudoelement for that. We already have ::first-line, which could perhaps be considered an abbreviated ::line:first-of-type. Though, ::first-line doesn't seem to support enough properties to be useful here, so maybe another approach is needed.


My only thought on this was to have a strip down the side with a vertically repeating background of an SVG data URL with the clef in it. But I don't like it. It'll be brittle. And it wouldn't support clef / key / time changes very easily.


I don’t know that this could be done cleanly without intertwining stlying and line breaking, which quite honestly sounds like a nightmare. (Line breaking is enough of a horror show as is, what with ligatures and bidi and ...)


I started the article thinking "ohhh the horror, this will not go well." And I ended up being mildly impressed with the typesetting quality, especially for the relative simplicity of the approach. So kudos to the author for demonstrating the flexibility of CSS.

I am concerned that there are lots of edge cases, essentially ligatures for engraving, that might not compose so well. A triad, or the author's called-out relative head spacing of 8th and 16th notes, or letting the program align different parts across different grids - would this also work well? Lilypond has proven to be exceptionally flexible for these kinds of complexities.



It would be nigh-on impossible to align parts across different grids – but it's perfectly possible to generate one huge grid with multiple staves in it. I'm pretty confident that will work out.


> align parts across different grids

Maybe a CSS `subgrid` would help? Subgrid is newly available. (I know nothing about music notation, and basing this entirely off that statement).



This is very cool! Like the author, I'm pretty impressed that just CSS can get you this far.

I'm very excited to see the custom element too! I had an intern work on wrapping VexFlow with web components a few years back, but the summer ended before everything was finished, and it hasn't been maintained: https://github.com/PolymerLabs/vexflow-elements/blob/web-com...

A maintained and easy-to-use library could do a lot of good for music notation on the web.



Nice to have an alternative to Lilypond (lilypond.org), but given the extreme complexity of notation, I would bet that any brevity gains are short lived.

For those Asciidoc freaks among you, Lilypond is fairly easy to get running in your Asciidoc toolchain of choice. I use the DocBook PDF pipeline, and the lilypond output is quite nice looking. It's awfully TeX-like.



If you can make do with a more limited feature set, I'd properly go with a CSS alternative, rather than using Lilypond (depending on your environment and use case). Lilypond is fairly complicated and not without security risk and have been used as an attack vector due to it being able to embed Postscript.


But does Lilypond generate responsive sheets?

That to me was the coolest part of this (apart from what others have said, the power of modern CSS)



You don't have to render to PDF, you can just have some UI that keeps re-rendering Lilypond source to your screen size and zoom level every time you zoom.

Or render each measure to a separate .png file and just for each measure. It will wrap and re-flow, you just have to deal with the clefs separately.



"you can just have some UI that keeps re-rendering Lilypond source to your screen size and zoom level every time you zoom."

And have you done that or seen it responsive?



If you want it to be responsive just do the Apple trick of instantly presenting a highly blurred image until the render is complete. The blurred image doesn't even have to be of the real thing, but it makes users feel warm and fuzzy.


Not everyone needs to typeset a full symphony with all the crazy notation for every single instrument though, having an easy responsive web presentation for even 50% of the "simple" scoring you do is a fantastic option to have.


Can't say I share that conviction? This is absolutely perfect for stuff like "I came up with something, let me score it and share it" without having to reach for notion/musescore/etc or lilypad.


At least for Guitar, that's far from what you need even for simple scoring. I'd be surprised if you get enough support for fairly straightforward piano scores either.

Don't get me wrong, this is amazing work. It's likely enough for any kind of "chord and basic melody to help you remember enough to get through the gig". But for actual scoring, lilypond & friends are still the tool of choice. (I wish it was easier. I have spent way too much time trying to convince it to do the things I want :)

I'm hoping it'll get there, though.



Nice! I run a website with music theory exercises where the notation is pretty simple. I’d love to switch to something like this, because the vexflow (what I use now) API is a little much of a re-learning curve for my twice-a-year-let’s-add-a-new-exercise cadence


I have spent weeks recently working on a little side project converting MIDIs to colored children’s piano sheet music. I am most of the way there but have been dragging my feet on building the web ui specifically because I was unsure how to render the notes in a flexible way that could look good on multiple devices. This looks like it could be a good jumping off point, and I fully intend to give it a try.

My daughter absolutely loves my Little Tikes piano from the 1980s but all the sheet music I find online, even for the newer Little Tikes pianos, have different colors associated with notes. I have built up a small library of simple MIDIs, and my intent is to have some preset toy pianos to choose from or let the end user specify colors-to-notes manually.



It's a nifty solution. But speaking as a music engraver, it could use a lot of improvement, and I don't think there's enough tolerance in CSS to make it work. The beams, slurs, and ties, in particular have real problems visually. This is why other methods of getting notation into the browser don't use such tools. You need pinpoint precision for vector rendering, which is why almost all browser notation is done with SVG or some sort of Canvas drawing.

Other than the clever solution of using CSS, why would you do this? One can already do scalable notation in the browser with other tools (Check out Adrian Holovaty's Soundslice or Sibelius Cloud Publishing).



What is a music engraver? I could google it, but I would appreciate a music engraver actually telling me vs some random page on the internet.


Sure. It's an old-fashioned term for the artisans who engraved music notation onto metal plates. These were then inked for pressing. It's a highly specialized skill and requires a deep knowledge of now notation works and how musicians will respond to it. Today it is all done on computer but the artistry of knowing how the notation should look and the meaning behind it is still there. That's the basics but the work we do is quite varied and complicated.

It happens that I work for Avid as a designer for Sibelius, the leading music notation program in the world. I also run the Music Engraving Tips Facebook group if you're interested in learning more.



That's very much it. You could also make an analogy to the arts of typography and typesetting.

It's of the same importance to a composer or musician that the notation is legible and beautiful, as it is to a graphic designer or reader that type and layout are legible and beautiful.

If the GP is interested in the topic, there are great videos by Tantacrul on his experience redesigning the notation font for MuseScore [0] and his overview of MuseScore 4.0's engraving improvements [1] - in particular this second video, concerning mainly layout, shows just how far this CSS approach would have to go to have a truly legible, reflowable layout in the face of beams/slurs/ties.

(I don't want to take away from anyone on the Sibelius team, they're likely even better experts on the subject than Tantacrul is, but as far as I know, they didn't make long-form Youtube videos about the topic! He also likely got the job of leading the MuseScore redesign thanks to his previous videos that critiqued and reimagined the interfaces of music composition software... including older versions of Sibelius [2] and MuseScore [3])

[0] https://www.youtube.com/watch?v=XGo4PJd1lng

[1] https://www.youtube.com/watch?v=Qct6LKbneKQ&t=2004

[2] https://www.youtube.com/watch?v=dKx1wnXClcI

[3] https://www.youtube.com/watch?v=4hZxo96x48A



I know absolutely nothing about notation software, but I remember watching that MuseScore rewrite video (link [1] above) a few months ago and was absolutely enthralled. Definitely recommend watching Tantacrul's videos to anyone who wants to learn more.


As a player (jazz bassist) I'm amazed by the subtlety of making notation work. Oddly enough, most of my band's material is still not in computer readable form. A lot of it was hand copied.


>One can already do scalable notation in the browser with other tools (Check out Adrian Holovaty's Soundslice or Sibelius Cloud Publishing).

Can either of those be incorporated in one's own software, without paying somebody? (I don't see a license for this project, but I'm guessing it will be a lot more permissive than whatever that Sibelius thing has.)

Also, the examples for this project are simple leadsheets. I think your average jazz musician is probably a lot less fussy about notation than a professional music engraver would be.



> Other than the clever solution of using CSS, why would you do this?

Seems lightweight enough for maybe a music theory blog post or interactive notebook.



I utilized JavaScript to render music notation from pppp to ffff iirc that can connect to a MIDI keyboard, allowing users to practice along with the interactive notes. Initially, I experimented with Adobe Flex before transitioning to web-based solutions and yes, it can read and play any MIDI files to my SF2 soundfont.

The only problem is that MuseScore community took years to fix a missing measurement in MusicXML structure, I had to patch the code on my own.



The visual quality is really good.

I'm not entirely convinced of making this responsive, in the particular area of Jazz leadsheets. I've found myself preferring line breaks at regular intervals (mostly every 4 bars, with exceptions for pickups and alternate endings), rather than trying to cram as many bars as possible onto each line.



The beauty of the system is that a flex box rule of flex: 1 1 25%; will give you 4 bars per line (each averaging 25% of the width). The system is flexible.


imagine a bot drone that flies around a big city like NY, and just tags walls + suitable spots with interesting gen art from various sources .. likely a lawsuit in the making but cool to see.
联系我们 contact @ memedata.com