greptilian logo

IRC log for #sourcefu, 2018-05-22

http://sourcefu.com

| Channels | #sourcefu index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

All times shown according to UTC.

Time S Nick Message
01:40 sivoais prologic: oh wow, you've been looking at common workflow language too?
01:40 sivoais i've been following their mailing list
01:42 sivoais it's another one of those projects trying to use semantic web tech ;-) admirable, but hard to jump right into. Thankfully they use JSON-LD (but they also support using YAML instead of JSON --- great decision imo)
01:45 prologic yeah
01:45 prologic briefly
01:45 sivoais when i was doing bioinformatics, making pipelines fit the problem so well --- though i need to look at how CWL's runner does caching
01:45 prologic but the problem is it's overkill as I stated earlier
01:45 prologic it is what it is *sigh* acamedics
01:45 pdurbin We just added a little JSON-LD to Dataverse: https://github.com/IQSS/dataverse/pull/4252
01:46 prologic anyway this isn't something I intend to implement right away
01:46 prologic I've been working on msgbus for a the past few weeks which is going to be the backbone of the distirbuted queue for my (unpublished) je (job engine) project
01:46 prologic at some point I'll build a workflow engine on top of je
01:48 sivoais web tech based? I'm looking at the code. I've wanted to do something similar with zeromq
01:49 prologic But OTOH you can already do stuf flike this (contrived):
01:49 prologic $ job run -r echo '2 + 3' | job run -i -r bc
01:49 prologic 5
01:49 prologic sivoais yes msgbus is web-based
01:49 prologic https://github.com/prologic/msgbus
01:49 prologic it's pretty mature tbh
01:49 prologic I use it mostly for "generic webhooks" atm and prometheus alerting
01:50 prologic next it'll be used as the backend for je (job engine) as it's distirbuted queue
01:52 pdurbin When je is launched, what will it compete with?
01:52 prologic in terms of feature-set?
01:52 * prologic doesn't complete with anything or anyone but himself :)
01:53 prologic if feature-set; probably things like AWS Lambda, OpenFaas, irion-functions, etc
01:53 pdurbin yeah, features
01:53 prologic and some inspiration from some non-OSS internals things at FB
01:55 pdurbin serverless
01:57 prologic yeah that's the latest "marketing buzz" word for it :)
02:00 pdurbin sivoais: my only exposure to zeromq was via salt
02:42 prologic msgbus shares similar features to *mq
05:04 sivoais my main exposure to zeromq was through writing a kernel for Jupyter. I've also seen some neat ideas about using it to bridge with an embedded Chromium which I thought was neat.
05:04 sivoais double neat, eh? :-P
11:22 pdurbin :)
22:10 philbot joined #sourcefu
22:10 Topic for #sourcefu is now http://sourcefu.com | logs at http://irclog.greptilian.com/sourcefu/today
22:18 pdurbin joined #sourcefu

| Channels | #sourcefu index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

http://sourcefu.com