18 Followers
84 Following
103 Posts

Marin Benčević, Ph.D.



Improving the ways we train and evaluate deep learning models in medicine.



Postdoc @ FERIT, J. J. Strossmayer University of Osijek, Croatia

Going forward, preprints will form the basis of HHMI’s assessments of its researchers’ work.💪

Starting January 1,2026, HHMI will require its scientists to post their research articles as preprints under an open license that allows unrestricted reuse (CC-BY-4.0).

This new policy aligns closely with the response provided recently by ASAPbio to an NIH request for information.
We elaborate on the new HHMI policy in our recent blog post 👉
https://asapbio.org/hhmi-enacts-immediate-access-to-research-policy-for-its-scientists/

HHMI Enacts “Immediate Access To Research” Policy For Its Scientists – ASAPbio

The Howard Hughes Medical Institute (HHMI) is requiring its scientists to post their research articles as preprints under an open license that allows

PL - ASAPbio
I like to exit my vscode tunnels the same way I exit all of my social obligations.

Excellent news! We got a small amount of funding to hire two people half time to help put together a Horizon Europe proposal for Safeguarding Research and Culture [1].

The idea is to develop the SciOp catalogue software to make distributed archives part of the Fediverse, riding on BitTorrent, and get more institutions, libraries and archives involved. With a focus, in this case, on Europe.

If you are interested in preventing digital cultural heritage materials from falling through the memory hole, preventing marginalised and racialised groups from being erased from view, decentralised, federated and peer to peer technologies and have experience with putting together EU Horizon grant proposals, have the right to work in the EU or UK and would like a part time job starting yesterday for a couple of months, please get in touch!

[1] https://safeguar.de/
[2] https://sciop.net/

#FediHire

Safeguarding Research & Culture

"As researchers we often say 'we need the data'. Today, the data needs us." — Kathy Reid

Safeguarding Research & Culture
I don't like NumPy https://dynomight.net/numpy/
I don’t like NumPy

it’s too hard

DYNOMIGHT

As a computer scientist, I often wish I had more training in social science methods. This paper is a really good example of things we computer scientists forget to think about. It describes how to model the measurement process and how to measure unobservable abstract constructs such as race, gender, emotion (all common DL biometric applications!) etc.

https://arxiv.org/pdf/1912.05511

Just one thing…

How to survive in research…

Over on Blue sky I found a link to this piece by Daniel Nettle – a reflection on life as a researcher, the race for the glittering prizes of high profile publications and how to “succeed” in academia, where succeed has the simple metric of ‘in ten years.. to have remained alive, and ideally continued doing some research.’

Ten years ago in Greenland, I did not imagine I’d still be doing this job-

I found myself very much nodding along with the sentiments of the piece, the conceit that

“Our seduction was by the primary research process: the idea that you could find a question; hit on your own approach; perform and manufacture the work; and finally, see it there in print, with your name attached, a thread woven in to the tapestry of human knowledge. A thread of memory.”

that also motivates me and apparently others in the research world. I still think that idea of building something bigger, no matter how tiny the contribution, the sum total of knowledge is a motivating factor. As Daniel writes, it’s a seduction, but it is also one that resonates and lasts, even through those years when the grind gets you down…

This part also made me laugh in recognition about what makes people persevere in research:

“If she [a student interviewing professors about success in academia] knew how narrowly I have hung on, I thought, she might have chosen someone else for her assignment.”

It’s not always easy keeping going, much of our work requires intrinsic motivation and it too often dissolves into something self-destructive. Famously, science and research in general is prone to mental health problems and I rather liked the characterisation here:

“Periodic demoralization and depression are not rare amongst researchers. It’s not not caring any more, or not being able to be bothered, as depression is often and erroneously characterized. It is caring so much, being so bothered, that one cannot advance on any front. One drowns in one’s own disorganized and gradually souring passion. This feeling is probably near-ubiquitous too.”

But persevere we do and persevere we must and where I thought this piece gets really interesting is where he points to the techniques and lessons that lead us to surviving the academic environment. As the essay is rather long, and a pdf, I thought I would summarise his main lessons here. The first one is I think the most important and while he calls it every day has to count for something (where every day means every *working* day, time off is still essential). I prefer to summarise it as just one thing.

Lesson 1. Every day has to count for something

“I try to start each working day with a period of uninterrupted work. Work, for me, is: collecting data, analysing data, writing code, drafting a paper, writing ideas in a notebook, or just thinking. Things that do not qualify as work are: background reading, literature searches, answering correspondence, marking students’ assignments, peer-reviewing a paper, sorting out my website, correcting proofs, filling in forms, tidying datasheets, having meetings, and so on.”

This goes back to paying yourself first. I’m not always very good at doing it, but I also try to do something meaningful and deep work like each day. Part of the reason I have found the last few months quite hard at work is a surfeit of meetings, workshops and travels, which have been in general quite destructive and distracting from the main work of the day, which could probably be summed up as, learn how the icy bits of the world work. My #AcWriMo efforts as well as #30dayMapChallenge in November were in effect just the kick start I needed to get back into the real scientific work of research, because as Daniel Nettle so eloquently put it:

Daily deep work keeps the black dog away, for there is nothing worse for mood than the sense that one is not progressing. And it can spiral in a bad way: the more you feel you are not progressing, the worse you feel; the worse you feel the more your hours become non-deep junk; and the more
exhausted you are by non-deep junk hours, the less you progress.

Not all black dogs are bad.

Lesson 2. Cultivate modest expectations

This was a curiously freeing part to read and I absolutely agree with it. Too often what John Kennedy calls Natureorscience papers are seen as the gold standard. And yet as Daniel Nettle eloquently points out:

the glittering prizes we academics strive for are positional goods kept deliberately scarce by bureaucratic or commercial interests, and allocated in ways whose relationship to long-term value is probably quite weak. For example, Nature is a for-profit enterprise that rejects nearly everything in
order to defend its exclusive market position. If we all send everything there, the rejection rate goes up. If we all increase the quality of our science, it still nearly all gets rejected, by the very design of the institution. The idea that all good papers can be in Nature or Science is as ludicrous as the idea that all Olympic athletes can get gold medals, but without the strong link between actual ability and finishing position that obtains in the Olympics.

It’s absolutely true that a natureorscience paper on the CV is seen as a big thing, the ultimate to strive far. And it is. Getting through the review process is in itself an achievement. But it’s also worth bearing in mind that many natureorscience landmark studies don’t stand the test of time. They rarely shift paradigms, though they can focus attention on new subjects, and sometimes that’s a new and important field. And sometimes it’s a distraction. I can think of several notable examples published since I started working in glaciology (but no, I’m not going to call them out here). The text in these journals is often far too compressed to get important details in, I recall an old mentor suggesting that the natureorscience paper is the advert, the starter that reels you in. The good stuff, the actual filler that makes you look at the world anew with its insights, new methodologies and the rest, is very often in a very different journal. So go for natureorscience if you get the opportunity, and if you have the results, but aiming for there from the start is not necessarily the right way to position your research career. Though as this post is now veering dangerously towards giving advice rather than simply expressing my usual slightly scrambled thoughts, take this one with a dollop of Atlantic brine..

For what it’s worth though, I do believe this:

Great art often begins on the fringe. Similarly, valuable future paradigms and innovative ideas start life in obscure places. Journal editors cannot yet see their potential, and the authors themselves are tentatively feeling their way into something new. So by focussing on capturing the established indicators of prestige, you distort the process away from answering the question that interests you in an authentic way, and into a kind of grubby strategizing.
Or so I tell myself, admittedly through clenched teeth at times.

Lesson 3. Publish steadily

Is back to just one thing in a way.

the mistake a lot of people make is focussing too much on getting the big shot, the single career-establishing paper in a top journal, and therefore not quietly building up a solid, progressive portfolio of sound work.

Doing the work is the best advice I can give and the advice I would give myself back in the early days of what has become (almost by accident) a research career. Now, I would hesitate to say publish something every year. I know scientists who insist on one first author paper a year, and some who strive for 3. Both seem arbitrary and potentially dangerous in terms of motivation, particularly for a young ECR just making their first steps and unsure of how to do it. Nevertheless it’s certainly true that, regardless of publish or perish, just the feeling of making forward progress, however incremental, is so important. Keep the momentum going. It’s part of what makes the traditional british PhD ending with a big book so hard, there’s no feedback on the way. Just an hour a day (or even an hour a week in busy times) is enough to keep me moving forward, and it’s often enough to produce a decent paper, eventually. And don’t worry, science is highly collaborative, I wouldn’t be able to do it without all my colleagues to remind me on, nudge me to get on with something and keep the wheels turning. I love you all for it too…

So if you are worrying about staying the game, rather than planning your next Science publication, I would ask yourself where your 1-2 solid papers each year are going to come from. Just as you should not go a single day without proper work, you should not go a single year without publishing anything, as one year rapidly becomes three.

Lesson 4: Get your hands dirty

This is why I do field work. But it’s also why I’ve embraced the opportunity to learn more about deep learning and AI/ML methods. Learning new stuff is exciting, it keeps you fresh and helps make new connections. It’s when disciplines cross-connect that the exciting stuff happens and the sparks fly in the brain.

“Keeping your hands dirty also means learning how to do new things. And this is a good thing: the skills I picked up in graduate school could not possibly have sustained me this long. Learning new skills has always paid dividends of one kind or another; and stepping back from doing primary research myself has always been the point at which things have started to go less well.”

I have written one too many white paper style articles recently, it’s time to go back to the field, and back to the code to see if we can make things better by integrating the data and the models.

Learning to fly a drone and to process the data is something I’ve been working on the last few years. I have a really exciting dataset now but little time to work on it. Ifyou’re looking for an interesting MSC thesis project get in touch!

A note of caution though, it’s always easier to start something new than finish an old project. The best colleagues will help you stay on track and make sure you finish what you started!

I’m going to add one more point, which isn’t expressly mentioned in the original piece that started this ramble:

Lesson 5: Cultivate outside interests.

Far too many of us put families, friends, sports, hobbies and anything else that doesn’t taste of work to one side, in pursuit of the all-consuming. It’s not only not healthy, it’s also limiting. The brain needs time off to churn away by itself. You can’t force that unconscious process. Better to take a long walk to admire the flowers than try to twist your brain in knots when you hit a wall. A good night’s sleep is an amazingly effective part of the research process too.

So there we have it, some thoughts on being a (mid-career) scientist and how I have managed to stay in the game. YMMV as the Americans say.

Finally, all that I have said relies on having a supportive employer and good colleagues. The sometimes horrifying stories (take for example this one) of people being pushed out by bullying colleagues, or structural discrimination is a whole other story. And not one I’m going to take on here, but I would point out that without organisation, labour inevitably gets crushed by capital, so organise, join a union, find out what your rights are and make sure that you have a supportive hinterland to help you get through the bad times.

And everyday, do just one thing to help you advance.

#30DayMapChallenge #AcWriMo #blogging #job #Jobs #People #Science

Whether you think capitalism is the source of all problems, believe free markets the solution to all problems, or are somewhere on the spectrum, it's important to understand when, where, and why markets work.

Disclaimer: This post contains numerous oversimplifications but character limit here is 11,000, not the 110,000 needed to do the topic justice.

Markets are an example of the category of system I find fascinating: complex systems built from individual actors performing simple local tasks that have emergent properties that are useful. Ants finding food and birds flocking are examples of the same kind of thing.

ASIDE: AI grifters love to talk about 'emergent properties' of their systems. When they do, you should understand 'emergent property' to mean 'some behaviour that we didn't intend, don't understand, and that might go away in a future version'.

Designing systems to have desirable emergent properties is really hard. A lot of engineering is about trying to avoid having any emergent properties because we still don't have good tools for reasoning about them. Emergent properties are why the bridge opposite Tate Modern had to be closed: individually, each component was fine, but assembled together they each contributed to a resonance when people walked across the bridge at a normal walking speed that could have broken the bridge.

Markets are something of a special case in that they are a single system that has been studied for over two hundred years and so there are things that we know about markets that may not generalise to other systems with emerging properties.

Markets are trying to solve the problem of resource allocation. Typically this is in a real-world setting, though there have been some interesting papers using markets for scheduling (especially distributed scheduling) in computing systems.

Trying to efficiently allocate resources across an entire economy is really hard. The Soviets tried it with central planning and it did not go well. Central planning requires global knowledge of a system. If you're trying to schedule tasks on a CPU, you probably know how many cores you have and how fast they are, but even then you don't have full knowledge of how long each task needs and what the dependencies are. A country's economy is so much more complicated than this that it's hard to even imagine that they're the same problem. And things change quickly, which requires re-planning.

The idea of a market is that each participant has some resources that they can trade. If they make good decisions, they will be able to make more trades. How do you know it's a good trade?

This is where the first kind of common failure happens. Imagine you go to buy apples. One seller has fresh apples, the other has rotten apples. Obviously, you pick the one selling fresh apples. Now imagine that the apples are sold in opaque boxes with photos of fresh apples on the outside. As a consumer, you don't have enough information to be able to choose, so you will get it wrong half the time. You may be able to learn that oen seller has a bad reputation, but what if there are ten sellers and they all send a different representative and use a different trading name every week? Markets do not work unless customers have good information. It doesn't have to be complete information, but it has to be enough to make an informed purchasing decision. Data-harvesting companies such as Meta, for example, rely on people not being able to reason about the costs of their products and make good cost-benefit calculations.

Regulations help to redress this kind of failure. Without regulation, markets often stop behaving like markets.

If two apple sellers have equivalent quality (their goods are commodities: either can be substituted for the other) then they can compete only on price. If you sell your apples for less than the other person's apples, then you will sell more. To compete, they have to lower prices. Eventually, they reach a point where they cannot sell and make money so they do not lower them further. The price of apples converges on slightly more than the price of producing apples and the inefficient sellers go out of business.

The next common failure in markets comes because they don't account for externalities. If I'm dumping waste in the local river and you're disposing of it responsibly, my costs are lower because other people who live downstream from me are paying a lot of mine. This is a big part of the reason manufacturing moved to China: cheap labour helped, but being able to bribe officials to let you dump toxic waste anywhere made manufacturing a lot cheaper. The PRC started decapitating people who took that kind of bribe a few years ago, so it's a bit harder than it was, but any market that doesn't account for externalities will end up optimising well, but for the wrong thing. See also: fossil fuels, leaded petrol, CFCs in aerosols, and so on.

If you're an apple seller, you might realise that you can make an agreement with your competitors not to lower prices and then you all make money. You form a cartel. After a while, you realise you could make more money if you all raise prices together. Everyone wins (except your customers). Again, regulation helps here. The 20th century came with a lot of antitrust laws to prevent this kind of things (the history of it in the US is fascinating: the earliest antitrust law was passed because someone managed to get a monopoly on onions and some of the later laws are little changes that say 'this, but for commodities that are not just onions').

If you can lock people into your ecosystem, for example by having a stupid document format that is tied to the implementation details of your word processor that no one can replicate, you can prevent people from exercising choice. This, again, means that a thing that looks like a market doesn't behave like one.

Most recently, I've seen a lot of examples of a kind of market failure that is less-often mentioned in economics books: when people who make bad decisions are insulated from the outcomes of their choices.

A market works, in part, by ensuring that people who routinely make poor choices have less capital left and so their subsequent choices have less impact. But if you're a bank that causes a financial crisis and the government bails you out, this doesn't happen. If you're an investor in a privatised water company and the water company is asset stripped and you take home a load of money while the company fails, you don't lose out and can make more investments. If you're a person with a net worth of over a hundred billion dollars, you can make investments of billions of dollars that are really stupid and have a massive impact on the market that you put the money in, but are isolated (this is closely related to the cross-subsidy problem that some antitrust law covers, but it never considers the case where the investor is an individual). You can address this with wealth taxes and banking regulations, but most of those were repealed in the '80s and '90s.

There are a lot of other ways that markets can fail. I really like the idea of markets, but making them work well requires a lot of intervention. They have a habit of decaying to oligopoly without constant nudging. When they work, they do better than anything else that we've tried. When they collapse, they work about as well as having a small aristocracy centrally assign resources (ask the French how well that worked in the late 1700s).

I hope this email finds you when you’re lost and shows you what home feels like, the kind that reminds you how it feels to love without the need for walls.
#catsofmastodon the late great Gina demonstrates the curved universe theory.
"But let’s be clear: this “burnout” that secure scholars are feeling is phantom pain where their colleagues should be" thanks for this one @drmcastan.bsky.social wordsinspace.net/2024/12/13/t...

wordsinspace.net/2024/12/13/the...
Melissa Castan (@drmcastan.bsky.social)

More is less, or was it Less is more? Professor of Law~ proper work in Australian Constitutional Law, Legal Education, Human Rights Law. Improper work on Case in Point (+Just Cases) podcast https://podcasts.apple.com/au/podcast/case-in-point/id1774138689

Bluesky Social