7 things I wish I would have done during my tenure track

Recently I’ve seen some Twitter threads on advice for new PhDs/postdocs/PIs. I’ve shared this about my PhD before (see 7 things I wish I would have done during my PhD), and in my current job I’ve been reflecting a bit about how my previous job went, I thought I would also share the 7 things I wish I would have done during my tenure track!

They are:

  1. Being in the office less
  2. Not agreeing to only teach undergraduate courses
  3. Spending less energy on grants
  4. Divorcing my email accounts
  5. Getting a Macbook
  6. More papers with people from Twitter
  7. Sharing more work online

1 Being in the office less

After starting my tenure track in February 2017, my best-case scenario day would look like this: I would leave my house in Rotterdam at 7:20, to take the train and get to the office at 9:00. Similarly I would leave at 16:50 and get home at 18:30, in time for dinner. There were sometimes disruptions, with me arriving 1-2 hours late in either direction. Maybe not too bad considering depending from where in the world you are reading. And as a plus I could work in the train – I would often read or draft blog posts.

After two years of working at home, I cannot imagine being able to do these kind of hours again. Although I was already quite mindful of the hours I would spend on my job, I didn’t realize that doing productive things in the train also counted, and that I probably was not getting enough rest. I also don’t really understand why I felt it was necessary, as I wasn’t required to be in the office on specific days or hours unless I was teaching or had other meetings.

2 Not agreeing to only teach undergraduate courses

For the first three years, I was the course manager of a first year BSc project and taught in another third year BSc course. I enjoy teaching at multiple levels, but I think I shot myself in the foot a bit here. As I had no start-up, PhD students to co-supervise, etc, the main way to start new projects was to supervise MSc students. But since I wasn’t a person the then-MSc students were aware of, recruiting such students was rather difficult.

3 Spending less energy on grants

Funny given that during my PhD I wish I had “applied to all the things”! As part of my tenure track conditions I had to apply for two “medium” (1 PhD position size) grants a year, which was reasonable, and it was useful to think about the project proposal. But several of these applications were doomed to fail, as even with a perfect score on the research proposal, my CV just was not “good enough” to get funding. Given that there weren’t many other opportunities to apply for, I guess overall this was still a useful experience, but I definitely could have spent less time on writing workshops, endless revisions etc.

Another advice was to apply for all possible small grants (workshops, collaborations) that I could get. I did that and actually got several of the things I applied for. But this was too much – relative to larger proposals, these cost more time to write, AND require more work from you after, without the option of hiring somebody to help.

4 Divorcing my email accounts

I used be very much a “one inbox” kind of person, and forwarded my university email to my Gmail. But with a new job and email account, I decided to try it out. Although Gmail has a much better interface than Outlook (don’t get me started on this…), I like it a lot. I don’t have Outlook on my phone, so I mainly have access to my work email during my work hours. This frees up a bit of headspace during time off, which I would often already use to mentally draft emails, thus spending way more energy on emails overall.

5. Getting a Macbook

Similarly to me trying out a different strategy with emails, I felt brave enough to try out a Macbook after a lifetime of Windows. It’s kind of great, I’m still pretty inept at using shortcuts etc, but I don’t imagine going back anytime soon.

6. Starting more papers with people from Twitter

One of the most satisfying things in my career has been to work with people met on Twitter. The prime example is probably this paper about Twitter – some of us have met each other beforehand but I feel safe to say this was a Twitter collaboration.

Another highlight was this preprint with Gaël – it started because I agreed with him about AI being hyped too much and said “we should write a paper about this”. A longer revised version has just been accepted so keep an eye out.

I like slow science, so there are other projects that are amazing and that started on Twitter but are not out yet. Stay tuned 🙂

7.Sharing more work online

This perhaps sounds surprising since I share preprints, slides etc and would even write blog posts on a more-regular basis. But I still see so many things that I’ve done that could be possibly useful to others, that I did not share, either because the thing needed a bit more input (for example going from an undergraduate project to a preprint), or simply because I didn’t get around to it (for example rejected grant proposals).

I am not sure I will ever get to a point where I’m doing this better, but as usual, if there is something I have that might be helpful to you, just ask.

***

This is just my list! There are also a few issues others mentioned in the Twitter discussion that maybe I did OK with? and are therefore not on this page – but that’s for another blog post 🙂

How I Fail S02E12 – Prof. Lexie Ali (Educator, Diagnostic Radiology / Medical Imaging)

Prof. Lexie Ali is a Deaf-HOH Radiology Educator who runs a free educational organization : MRI Buzz https://www.mribuzz.com – designed to provide educational support, resources, and networking opportunities in one place for students or medical imaging professionals with lesser credentials.  

She has an additional background in Pre-medicine from Loyola University Chicago and University of Wisconsin – Milwaukee. While in the field, Prof. Ali authored many articles endorsing her colleagues and dear friends’ various educational programs. 

Prof. Ali co-owns MRI Buzz with her close friend – Matt Rederer. She is also an avid MR Safety Advocate / Speaker and hosts her own web series – “Let’s Talk MR Safety with Lexie” – on multiple social media channels.  

Furthermore, Prof. Ali sits on the Society of Magnetic Resonance Imaging – International Society of Magnetic Resonance in Medicine : SMRT-ISMRM’s Global Relations Board, helping to translate Radiology-specific Educational Webinars for individuals situated in other countries. She continues to author pending academic papers and/or assist colleagues with such papers/presentations and is also pursuing higher academic/educational prospects at UW-Milwaukee.

Hi Lexie, thanks for joining How I Fail! Next to your official bio, could you say a bit more about yourself? 

I am a Deaf-HOH Radiology Educator. I run my own free Educational Organization : MRI Buzz – https://www.mribuzz.com – and a Podcast: Let’s Talk MR Safety with Lexie –  https://www.youtube.com/c/mribuzz – on my official YouTube channel – to  advocate for safer patient care in MRI – along with side blogs/webcasts for inclusion in Medicine. I am also a DEI advocate with the goal of creating more inclusive spaces for Women and Deaf-HOH in Radiology, ER and OR spaces. That is also the reason why I sit on the SMRT-ISMRM Global Relations Board : I seek to include more diversity-based spaces in Imaging Education. Additionally, I love to expand in terms of academic prospects – so I aim to do more in terms of Diagnostic Radiology and completing the required prerequisites and residency for that. I am a little private with regards to my career and academic prospects but, my overall goal is to go higher than where I am. 

What’s a memorable failure for you?

My most memorable failure would be having had my facility closed for rotations during my final year of med school and then having had to struggle to find placements in time to graduate with my class. 

This was memorable for me because I was depressed to the point where I lost faith in God and felt the futility behind hard work. However, my Grandpa, who passed from COVID would always say things happen for a reason and that closed doors, lead to better windows of opportunities. This rang true – because after months of searching – I was able to find a teaching hospital with hands-on experience in terms of patient care and medical imaging. Being deaf, it is twice as hard to learn patient care, in fast and noisy spaces as hospitals. However, I was quite fortunate to have found a teaching hospital that was very accommodating to my communication needs as a deaf healthcare professional. Closed doors really lead to better windows. 

What do you think about sharing failures?

I think sharing failures is, uniformly, a good thing in the sense of inspiration to others who might have similar lived experiences. However, there are some caveats in that it might lead to judgment or micro-aggressions from some individuals who might view such openness as sensitivity or vulnerability. 

Are there any other topics we (collectively) are avoiding, that we need to discuss more often?

I think we are avoiding solution-oriented approach to social / political issues around us today – and instead – resort to negativity/ ‘bashing’ of said issues. For instance;  there’s more talk of ‘why racism is an evil virtue’ or ‘why Black Lives Matter dialogue is essential’ than ‘what training can be offered’ or ‘how law enforcement officials can be screened’ prior to being placed in service. We need to be discussing / having more solution-oriented dialogues. Everyone knows and talks about why something is happening but no one is talking about what can be done to prevent the something that’s happening. 

Is the situation changing? Do you see differences, for example across different fields? 

Yes, especially in Radiology, I am seeing more inclusive spaces for Women Radiologists. In an industry, that is heavily male-dominated, I am seeing a change in attitudes/mindset and acceptance/inclusion in spaces/field traditionally reserved for men. 

Is there anything that you are currently failing at yourself? 

At the moment, I am failing at striking the right balance between work and personal life. As with the pandemic, things are slower and it takes longer to finish tasks these days. So; that is the thing I am definitely failing at. 

If your ideas about failure have changed since you started doing research, who or what has been influential for this?

My Grandpa and my parents have been influential in changing my mindset and attitude towards failure. I used to think of failures as the end of everything that should have been going for you.  But really, it is the beginning of long-term success / success in the long run. 

Are failures something you discuss with the people you supervise/mentor?

Yes, I do. I have a lot of mentor figures in my field – Diagnostic Radiology. My first ever mentor was – Notable Radiologist – Dr. Emanuel Kanal – And everything I have learned and achieved today with regards to Diagnostic Medicine – Medical Imaging – is because he too – taught me to view failures as an opportunity to reinvent myself and come back stronger, harder. 

What types of things – successes, failures, habits, mood etc – do you keep track regularly, why/why not?

The one habit I keep track of daily is : Reading. 

And it is this habit that brought about my hidden talent for writing – which has gone a long way – in terms of collaborations with notable individuals across various fields. 

Keeping track of anything: be it success, failure, or a habit does go a long way in helping you accomplish what you set out for and more. 

Should we be sharing more successes? Not just traditional ones like jobs or papers, but what you are proud of today ?

Yes, we should be sharing more successes. Even the small ones. 

I remember – in the early 90s – in India : when I used to visit my Grandpa – those days we had a dial-up landline phone: which would randomly stop working. And the same happened, one such day. My grandpa walked all the way to the operator headquarters to get the service back. And when he returned, it did: we celebrated our phone working with great pomp and show. When you celebrate the smaller successes, they actually help you be satisfied if failures come your way and/or enjoy bigger successes better. 

What is such a non-traditional, recent success for you?

Being surprisingly good at hip-hop dancing. I actually do a lot of such dance duets with notable choreographers on TikTok and I never, in my wildest dreams, thought I would be good at setting up my TikTok page. 

Are there also reasons to not share (some) successes?

While sharing successes is a good thing in terms of inspiration for those struggling to achieve the same – there comes a point – where you deliberately DO NOT want to share the same successes : because sometimes the same success can remain incomplete in the form of obstacles because of the rush to take up space and competition as thus.

What would a ten year younger you think of you now? 

A ten year younger me would think of me as a stronger, emotionally mature person, who is satisfied with both failures and success – rather than the rush to ‘be something’.

What advice would you give to that person? 

I would advise the younger me to exercise more patient and be satisfied with what comes my way. 

How I Fail S02E11: Pradeep Reddy Raamana (PhD’14, Medical Imaging and Machine Learning)

Dr. Pradeep Reddy Raamana is an Assistant Professor at the University of Pittsburgh. He is interested in developing multimodal biomarkers for brain disorders, and the necessary data science tools to realize personalized medicine. He founded the special interest group on neuroimaging quality control (niQC) at the International Neuroinformatics Coordinating Facility. He is a passionate advocate for quality, reproducible and open science. He leads the Open MINDS lab @ Pitt (now hiring!), where they develop multidisciplinary techniques for computer-aided diagnosis (CAD) and precision medicine, with a motivation to improve data quality, reproducibility, performance of predictive models and their potential for clinical translation.

Hi Pradeep, thanks for joining How I Fail! Next to your official bio, could you say a bit more about yourself?

Thanks for inviting me, Veronika! I would like to think I am a simple straightforward guy trying to improve the world around me in various ways I can. I think a good way to be happy is to make others happy! They sound cliché but that is in fact where I derive my motivation to find value in my actions, work and life in general.

That is also a key motivation for me to choose the academic career, which I believe would give me the opportunity to 1) develop necessary techniques and tools to improve healthcare, and 2) [at some point soon] provide a sufficiently stable and independent platform to speak my mind and pursue solving whichever problems (broadly speaking) I believe would make the most impact. I hope to pursue it by rejecting the traditional careerist approach, and help reform it by eliminating various sources of toxicity in academic life for all stakeholders involved including trainees and faculty.

A recent step I am taking in that direction is to “boycott” all interactions (reviewing, editing and submitting any academic outputs including papers and books) with for-profit publishing businesses like Elsevier. The motivation is to eliminate the subjective (and arguably disproven) concepts of “prestigious” and “high-impact” journals (by relying on high rejection rates and impact factors etc) from our peer-review discourse as well as in hiring and promotion policies.

I believe sticking to publishing only in society-run journals that are accountable to the members of their scientific society would give us the power to choose the peer review criteria (focus on validity, not on accumulating citations to charge higher subscription fees), and optimize them towards what is ethical and best for science. This would also reduce the costs for publication and be more inclusive.

Given great adoption of open science we are seeing which includes transparency in peer review, we can adapt the policies of a society-run journal based on the best available evidence. Within a society-run journal, members would have option to reject many unethical and toxic practices we notice in many for-profit journal businesses such as

  1. picking for “shiny” topics and encouraging authors make inflated claims,
  2. extracting within-same-journal citations from authors (to manipulate their IF),
  3. unnecessarily large number of revisions to leech off many-fold submission fees as well as to
  4. create a false appearance of faster processing time from submission to publication.

I urge everyone to join me, esp. those with sufficient job security. 

What’s a memorable failure for you?

Great question! Besides the typical failures we all face, I think the most memorable for me would go back all the way to the first year of my PhD where I felt the euphoria of building a “perfect biomarker” to diagnose AD “accurately”. Like 100% accuracy in my evaluation (using an SVM classifier I think – they were all the rage then!). I thought I won the jackpot and was super happy. That lasted only 10 minutes or so until I discovered I was totally double dipping!

On Twitter you shared about null results during your postdoc – can you explain more about this?

I was referring to a key project in my postdoc to build neuroimaging “biomarkers” (loosely speaking) for Major Depressive Disorder (MDD). When I was just getting started on it, there were few review papers implying the possibility and potential of neuroimaging to predict response to treatment.  I did have sufficient expertise with both machine learning and imaging-derived features: the focus of my PhD thesis was exactly that but focused on Alzheimer’s disease (AD) and related neurological disorders.

I picked it up with enthusiasm but after a long series of attempts to evaluate the predictive utility of know biomarker candidates as well as some new ideas we had, I realized neuroimaging-based features (various versions of morphometric and functional connectivity) were no better or only slightly than chance. As you know it’s harder or impossible to publish null results, except in specialized/non-popular venues. Hence, I kept digging deeper and wider to try find a “somewhat positive” result, and I must say I failed thoroughly. However, I must say I succeeded in thoroughly understanding various challenges related to predicting response to treatment in MDD well.

If you ask me how I viewed it differently then and now: then, I saw it as an exciting, important, high-risk high-reward challenge, that will demonstrate my expertise and diversify research “portfolio” so to say. I was skeptical of the published results (based on my previous understanding of the AD literature that most biomarker studies reported inflated and/or overfitted results).

But looking back I feel I didn’t think sufficiently through various possible outcomes and whether they align with my career plan i.e. I should have asked the hard questions first: 1) will the results be publishable, and 2) do they add to and merge as a coherent part of my research program in my job talk etc? However, I don’t regret that effort at all! I learnt a lot from this exercise that I wouldn’t have learnt otherwise esp. challenges in in the world of psychiatric disorders. But I am thoroughly disappointed in the system, structure and community around us that would rate that effort (without big papers to show) towards nothing.

Is there a story behind your name “Future Distinguished Emeritus Prof” and bio “without an agenda”? 🙂

LOL, that title is a joke on the high prevalence of Named Professors / Chairs in the academy, which I believe are related to donations into the university. Given the already-hierarchical nature of the academy and concentration of power into few rich clubs, this never-ending quest for more titles incentivizes “generation of money” from new sources proposing all sorts of research. This quest to climb the ladder higher and higher leads to piles of papers in flimsy fields that don’t really move the needle in the context of larger challenges to society, that they are supposed to help with.

This is also related to some traditional biography pages I read which are just a really long list of such “titles”, and I remember saying to myself “OK.. that’s a stack of “trophies”, but tell me what you actually do?”. I personally believe titles shouldn’t get in the way of a good conversation or a debate, and we must evaluate comments on their substance and merit. So, the prefix is just to indicate I will also have few titles in the future. Some on Twitter told me it made them chuckle! J

The “without an agenda” in my Twitter profile is to clarify how I try to conduct myself there: to keep it real, unfiltered and without a specific agenda towards promoting a certain set of topics or people. Few years after I started using Twitter routinely, I’ve noticed how some powerful people promote only those (people or papers) that suit their agenda, and not all the good work that exists. That is really upsetting when it is done by those claiming to be a champion of open science. This saddened me deeply, and I decided to try keep it real and be myself.

The “without an agenda” is also a disclaimer and “warning” of sort for people thinking of following me (many find me based on my research) on what sort of content/feed they can expect when they follow me. I am not trying to virtue signal here, and I probably have blindspots and biases myself. I hope to learn them and correct them to the extent possible.

It seems that you are pretty open about topics others might be avoiding. How do people usually respond to this?

Great question! I’d love to hear from the community what they think of my timeline 🙂

As a true believer in open science, I think it is essential to be as open and as honest as possible. As is true in broader life (relationships, politics etc), only honest discourse from everyone leads to real and sustainable progress for all stakeholders involved.  So, I try not to filter any comments or questions I have and try providing an open outlet/forum to discuss all topics, regardless of whether I think that particular tweet or topic would be well-received or not. This process of sharing (past some basic filtering) also helps me a keep a journal of sort over time, and over multiple debates on similar topics.

As for how people respond to this, I think there is definitely those who listen to what I have to say, offer thoughtful responses, advice and support in their own ways. I’d like to sincerely thank them, and consider them my friends! They certainly keep me going, as I don’t think I’d have decided to pursue the academic career if I didn’t find that open and supportive community in time.

That said, they are more on the smaller minority, and I feel there is a clear and strong tendency to avoid any “negative” and non-work topics. Engaging in these debates is considered “unproductive” by some. I might be wrong but one of the reasons for this is many researchers treat academic Twitter as another social media channel to promote their work or themselves (“brand management” comes to mind). That is their choice, and that is not wrong, but it doesn’t help with facilitating important open conversations to be had.

There is also a clear and noticeable tendency to popularize who are already popular e. g. an identical idea or comment from a “well-known senior researcher” would get disproportionately more attention than otherwise. I don’t claim to understand how or why that happens, but I think the tweet should matter much more than the tweeter.

Are there any other topics we (collectively) are avoiding, that we need to discuss more often?

Yes – there are a few (which I have been trying to shout out loud and often):

  1. More debate and realization towards how we the academics are squarely the source of many of the fundamental issues in science
  2. More honest communication with prospective PhD students on what academic life is really like, and the bleak prospects for many towards a traditional Professorial career, and why we should strongly discourage many to pursue a PhD in the first place
  3. Why we should eliminate the concepts of “prestige” and ranks in our discourse, starting with journals (Impact Factor etc), and then universities

Is the situation changing? Do you see differences, for example across different fields?

Yes! Based on my experience and bubbles (which is arguably limited and likely not representative of the full academia at large), the “computer sciences” seem to be more open compared to the more “clinical” and life-sciences fields. This may be due to differences in training, and perhaps because the tools and platforms to share (relating to computers and software) are much more natural and integrated to them. I have definitely noticed “hierarchy” and “authority” play a bigger role in the more clinical / “hardware” fields relative to the “software” fields. Again, I could be less than accurate as this was based on my own observations and anecdata.

Is there anything that you are currently failing at yourself?

Yes! I suck at time-management and sticking to my plans and priorities esp. in the medium term.

Do you have a success that is not a traditional one, like jobs or papers, that you are proud of today?

As I participated in the American Elections debates online over the years, I noticed they were only worsening the political divide and weren’t helping with bridging the gap! Hence, I’ve been itching to meet the real American voters in the real world and something “real” instead of another Twitter debate. While the pandemic didn’t really help this cause, I was able to visit many poll centers in the Greater Pittsburgh area to distribute water and food on the historic 2020 American Election Day.

The original idea was to help the voters stay in line and make sure they vote as Pennsylvania was a critical swing state. However, as large numbers voted by mail, the lines weren’t as long as expected. So, I was able to help the poll workers themselves! They were visibly and clearly delighted to see somebody offer them water and chocolates. And that was an experience I wouldn’t forget for sometime.

How I Fail S02E10: Charles T. Gray (PhD’21, Interdisciplinary Computational Metascience)

Charles T. Gray is a reformed musicologist, one-time fire twirler, former inter-library loans officer, and intermittent typist. She spent the nineties immersed in Melbourne’s vibrant street-punk scene, and it was every bit as fun, confronting, and political as it sounds. She is currently a postdoctoral scholar with Newcastle University’s Evidence Synthesis Lab, where she specialises in Bayesian network meta-analysis for Cochrane intervention reviews. She has three bachelor degrees: music, arts, and mathematics. None of these prepared her formally for her current occupation. Nevertheless, she believes that working in the performing arts is the perfect precursor to academia.

Hi Charles, thanks for joining How I Fail! Next to your official bio, could you say a bit more about yourself? 

It shouldn’t be shameful or taboo that I had a shitty childhood, nor that this continues to shape my adult life today. I manage with a variety of practices: medication, yoga, VR fitness, therapy, literature, bullet journalling, and peer support groups. 

We need to change the dichotomised understanding of people as broken or crazy and others as normal. We’re all capable of being irrational, overwhelmed by past feelings. 

No one is irreparably broken, and having experienced hardship, even rape and physical abuse, does not mean we cannot contribute meaningfully to society. Indeed, if we listened to survivors more, I believe we’d all learn a great deal. 

Everyone experiences trauma; people with my past simply have a masterclass in it.  

What’s a memorable failure for you?

Getting through high school was a huge effort, finding myself homeless and on the streets at fifteen after life with my parents became untenable. Despite dropping out for half of school, I got myself into a top university.

I supported myself through my degrees by working as a piano accompanist and teacher, enduring gruelling hours, and when I finally finished with a double degree and a thesis, I thought my fortunes would change. Instead, I graduated into the 2008 Global Financial Crisis, and discovered that society didn’t much value my music degree, nor my arts degree. 

I cast wider and wider nets trying to find work; a low point was not even getting an interview for a two-hour a week cleaning job. I applied for everything and couldn’t seem to get interviews. I found myself careening towards the age of thirty feeling as if I’d completely failed in adulting.

At this point, to make things worse, I finally accepted that I didn’t enjoy practicing music anymore. Indeed, my passion was theory, not performance, but there was no work in music theory. My only source of income was something that I was not only bad at, but lacked the drive to become good at it. At this point, I’d been practicing music for twenty years, and I was fatally bored. 

I wasn’t sure I’d ever find the strength to get myself out of that situation, after struggling so hard to get myself into those courses in the first place. It is, however, astonishing what inner resources one can muster when the alternatives are so much worse. I took action, beginning studies in mathematics at thirty, when I began to suffer insomnia so badly that I was struggling with the basics of life.  

You’ve had a major career change, that people have told you would not be possible – how does that affect you going forward? What would be the advice you would give others in a similar situation?

There are widely-held beliefs about fixed and innate skills, but most skills are learnt through hard work and perseverance. There will always be outliers with amazing abilities: five-year olds who can play Mozart piano concertos or solve complex equations. However, this does not mean that one shouldn’t try. 

To combat the gnawing, ever-present anxiety surrounding being good enough in my ten years of mathematics study, spanning my thirties, I reminded myself constantly that my goals are modest. All I want is to work in mathematical science, ideally research. There’s a reason research isn’t performed by five-year old prodigies; it wasn’t a requirement that I be gifted, merely competent

Working long hours meant I was forced to accept my marks would be lower, that I wouldn’t be top of the class. Rather than comparing myself to others, I ask myself over and over, is what I’m achieving good enough for the next step toward my goal of working in mathematical science?

Code like a girl poster with Charles Gray

You will soon give a talk on failing at reproducibility at the R-Ladies Toolbox Series, can you say something more about that?

Reproducibility is a hot topic right now. If the twittersphere is anything to go by, psychology seems to be consumed by flame wars surrounding replication of results and preregistration. 

Computational reproducibility is analogous in statistical science. We are witnessing a dizzying proliferation of software tools and methodological standards of best practice. 

I tried and consummately failed at creating a reproducible doctoral project. I want to save others from the internal agony of feeling they’re failing at keeping up with the Joneses of reproducible science

Why is reproducibility important in science? We wish to provide both means of validating our scientific results and extending on the work we’ve done. My thesis is a hot mess of TeX, .Rmd, .R, and data files. I doubt, even in the unimaginable event someone was inclined to reproduce that work, they could. However, by trying and failing, I learnt many skills and workflows that make my life so much easier now in my current research. 

I believe even so-called good enough scientific practice is unattainable. There’ll always be a tool or workflow one hasn’t mastered, let alone heard of. But by trying and failing, we inch all scientific practice toward better standards, and we learn beneficial skills. 

You have a bullet journal featured on your Twitter profile- what types of things do you track there, and how does it relate to success/failure for you?

My bullet journal is an integral part of my daily workflow to help me centre in the moment. I manage complex post-traumatic stress disorder, experiencing visceral flashbacks; my time on the streets as an adolescent, and the circumstances that brought me there, will always shape my adult life in large and small ways. Bullet journalling helps me to focus on setting daily, small-scale goals; and to somewhat mitigate the past distorting my feelings of success and failure. 

Paper bullet journal with a pen and a ruler

Keep putting one paw in front of the other, it’s all any of us can do. 

Practice diaries are common in music. We don’t need them for the flow-state days where we play Scriabin’s Etude in C# minor for 6 hours straight because we simply cannot get enough of the feel of keys under our fingers conjuring such transcendent music. 

Anything we have to do every day begins to feel like a chore, and it’s hard to stay motivated day to day, even if we do appreciate it when we achieve flow state. Practice diaries and schedules are for the uninspired, overwhelmed, and tired days.  

What’s a recent success, and one thing you are “successfully failing” at 🙂 

Last year I decided to take things easy. My scholarship had run out, but I had data engineering work on a large open science project. I ignored the hyperventilating from others about my timeline and decided I’d work part time and complete my doctorate in a relaxed manner. 

In part, the pandemic helped make this decision easy; if I had rushed, I would have graduated into a time where research was being slashed and few positions advertised. I decided it would take as long as it would take, provided I kept writing my dissertation fairly consistently, albeit part-time. 

My advisors noted how polished it was, and provided very few comments. Indeed, only one examiner had two small amendments. I was waiting until I submitted for examination before looking for work, but managed to obtain a postdoctoral position before this, that is, before I’d begun the job hunt. 

In some ways, this feels like the greatest achievement of all: a stress-free submission and avoiding the ontological angst of reimagining oneself for position after position, only to have those hopes dashed.  

The inspiration for this talk on failing at reproducibility is my newfound calm in the face of a torrent of scientific tools, workflows, and theory, that I’ll never possibly master sufficiently to all standards. As I try in earnest to be a good scientist, I know I’ll fail, but I also know the next attempt will be a bit easier. 

As I used to tell my piano students, you have to hit the wrong notes to learn to hit the right ones; what holds us back is fear of trying. 

How I Fail S02E09: Bernhard Egger (PhD’17, Computer Science)

Bernhard Egger is a postdoc at the Computational Cognitive Science Lab at MIT. His research is focused around inverse graphics in Computer Vision and Computational Cognitive Science. You can find out more about him on his website https://eggerbernhard.ch/ or on Twitter https://twitter.com/VisionBernie.

Hi Bernhard, thanks for joining How I Fail! Next to your official bio, could you say a bit more about yourself, and what made you join this series? 

Hi Veronika, 

I want to figure out how vision works: how human vision works, and how we can build computer vision systems that generalize. I choose to perform computer vision research based on an inverse rendering approach. I am convinced that Analysis-by-Synthesis is the way human vision works and the way we should build machines that perform vision in such a way. This idea puts me in an interesting niche in the community. During my PhD it sometimes felt like fighting a lonely battle against a huge flood of supervised deep learning research in the community – however over the last few years inverse rendering, 3D Morphable Models (3DMMs) and in general more model based approaches to vision are coming back. Even conferences like CVPR (the most important one in my field) are going more and more in that direction. I might have chosen a path that is not particularly fruitful when it comes to citations, but it definitely enabled a lot of steps in my career. Whilst a career in academia was less a master plan, than a “just in time” evaluation at each step, I would say it mainly worked out because of the niche I’m working in, that I found for myself. This niche for me is fun and therefore I can make an excellent, motivated story for a presentation – which I think is crucial for i.e. (faculty) interviews. 

I wanted to join this series mainly with the intention to show that not everything is as smooth as it might look in my CV, a lot of things that are important cornerstones in my CV had a significant component of luck involved – and there is also a lot of failures or drawbacks that are just not mentioned.

What’s a memorable failure for you?

My biggest failure was probably my first attempt to get a personal career funding grant –  I was following my partner to Boston, so I cold-called professors at MIT to get a postdoc position (a cold-call is how more than 40% of the postdocs get into MIT). I intended to get my own funding, by applying for a grant for 18 months, with an acceptance rate of about 50%

After visiting a lab at MIT and having support from a professor for the grant I was super pumped and confident that it would work out. I wrote the grant during a ski vacation (spending the days on the slopes). I then got feedback from the professor and also from my peers that it needs some work. I had one week to go – but I was super confident that with MIT as an institution and this high acceptance rate it should work out. So I did a little bit of work, but did not invest as much time as my peers would have recommended. 

In the interview (which is short <10 minutes) they basically took me apart and isolated the weaknesses of my proposal. They caught my vague formulations and found that for some essential parts of the proposal, I was just not certain enough how to do it. 

I was first disappointed and angry at the reviewers – but then quickly realized that this was my own fault – I took it too lightly and felt like a small kid testing his boundaries of what is acceptable and what not.

When preparing the revision for the grant, I realized how sloppy it was – I spent a whole month writing a proper proposal and got it funded in the second attempt. This however also led to a delay of my start at MIT and I moved to the US with a delay of 3 months after my partner.

Another big failure was an attempt to organize a workshop on 3DMMs at a major conference. We had a group of organizers together and wrote a decent proposal. It was rejected from both CVPR and ECCV (two major conferences in the field) in years where there were tons of workshops on “deep learning for x”. This was very frustrating, especially because a workshop should add content in an area that is not covered enough by the main conference. So in my eyes a deep learning for x workshop might not add much value to a conference that is anyway 80% deep learning for x.

After those two rejections, I basically gave up – but a senior person among the organizers told me “Let’s try to do a Dagstuhl seminar instead” and that worked out and was my best scientific experience so far!

Guess which conference added 3DMMs as an area two years later? CVPR… But it is not good enough as a CVPR workshop 🙂

What kind of topics are associated with failure, and are not talked about enough? What problems does this create for early career researchers?

I think academia just has this huge illusion of a perfect world: perfect CVs, perfect projects. When listening to a presentation, especially from a senior person the story will be so smooth it just sounds like everything was always planned that way. Some people include some failures in their presentation, but then more in a funny way than formulated as a real failure.

I really appreciate that you added a CV of failure to your website – I think it takes a lot of courage. It is refreshingly transparent and it would probably be valuable if more people would do so. However it might come at a cost: Will I be judged by others based on sharing my failures? And especially if there are only a few people sharing their failures it is easy to judge them. I don’t know what the right solution here is – everything public and transparent might be a bit much, but sharing failures within the lab, especially from the most senior person might be  valuable and create a culture of sharing failure. 

One other key topic that is prominent in academia is the imposter syndrome. I stumbled on an online test recently on twitter (http://impostortest.nickol.as/). And if you check #ImpostorSyndrome you will see tons of results from researchers with high scores in this test. We are in an environment where smart people come together, and almost always you will find somebody appearing smarter and more successful. It is sometimes really hard to not feel stupid in this environment. One important message here is that ~ 70% of people in academia feel that way – we can’t all be that bad 🙂 

Is the situation changing? And are there differences between different fields, countries etc?

I have hope that things are changing slowly. The first important step is probably awareness. Some institutions put big efforts into the mental health of their students and employers but some of the issues might be in the structure of how academia is set up at the moment. So fixing the final problem might not be as good as trying to change the cause. 

The main responsibility in my eyes lies with the advisors/mentors. I think the moment we mentor someone (starting from an undergrad level, over PhD students and including young faculty), we actively propagate the way we think academia should work to our students. A lot of my behavior and the way I see academia I learned from mentors I valued. If a mentor is particularly bad when it comes to real life challenges like mental health issues that is likely to dramatically affect the career of the mentee and pushes especially minorities out of the field. I also believe some of this can start with small things. I try to make authentic and honest statements that signal that there is room for discussions or self-care and hope this helps to do a small step in the right direction.

Is there anything that you are currently failing at yourself?

Yes – focusing. Over my PhD and postdoc I however started to accept it and just ignore all this self-optimization stuff 🙂 I still see it as kind of failing, mainly because it is easy to spot that I just lost some hours doing X (or nothing) and it feels like there is a constant drain of potential.

Are there specific people who have been influential to how you approach setbacks?

For me it is not really a specific person, but probably each one of my peers. The longer I stay in academia the more I realize that nobody is perfect, everybody gets grants or papers rejected. This definitely helps in the moments where a setback happens to normalize it and look forward. One of the most important strategies that I think I learned from others is to always look ahead – and usually some of the feedback of a review process is useful to improve the work to submit it again. And no, reviewer 2, I don’t think that I should just do deep learning instead!

Are failures something you discuss with the people you supervise/mentor?

I realized that failures like rejected grants or paper annoy me a lot, especially at the moment of the rejection. However after a few days I’m over it and either resubmit it or forget about it. I’m however terrible at giving good advice in discussing failure or rejections. When submitting a paper I already know that there is a big chance of getting a rejection, especially when aiming at the top venues – so once the rejection is in the inbox I’m not really surprised, usually annoyed about at least one reviewer, but I’m just bad in finding the right words to express my thoughts to the first author(s). I try of course to motivate them, and tell them that this just belongs to the experience in academia but what do you say the second or third time – especially if you are convinced that the paper is actually solid?

What types of things do you track regularly?

I’m crazy about my google scholar profile – I check it way too often and am always super curious who is citing which work. This was especially frustrating earlier in my career where it took super long till something changed and some citations even wrote something wrong when citing the work in their related works section. But recently it changed from being frustrating to be motivating – mainly caused by a nice survey paper that gets lots of citations!

That sounds familiar! 🙂

What about successes, should we be sharing more non-traditional ones, not like jobs or papers, but what you are proud of today?

I think such things can be very valuable, especially in a lab setting. Share success or setbacks with the lab in regular meetings. Here I really like the idea of a common coffee break which is common in Europe and not so common in the US. Such a coffee break is usually the point where smaller or different successes and smaller setbacks are shared and discussed and this interaction is definitely highly valuable since it is much more granular and also more personal than a paper acceptance or rejection. If somebody tried a new recipe at home and thinks everybody in the lab should know it – the coffee break is exactly the right platform. Or if you were waiting in line to submit a certain bureaucratic form for 30 minutes just to learn that you also need another one – that is another thing I think can find space in the coffee break. And there will still be enough space for scientific discussions or programming questions even with these little bits of personal success or drawbacks.

What is such a non-traditional, recent success for you?

I ran a marathon during my PhD and I was not shy about sharing it with everybody 🙂 The best part of it however was the training. It was together with a postdoc friend in the same lab and we did all the long runs on the weekends together. I really enjoyed all the conversations, especially since the brain seems to work really well when my body is busy with some other work 🙂 The final moment of then running a marathon and being able to actually finish it was a moment where I was proud of myself and just enjoyed that I actually did something that felt impossible half a year before (I could not run through a half marathon before training and it is not that I didn’t try).

If you’ve been a reader of How I Fail last season, what are your favorite lessons from the series?

I really enjoyed learning about the posters centered around mental health from Dr. Zoë Ayres:

This is an excellent and valuable resource that I plan to share with all my incoming future students since they bring a lot of things on the point that people rarely talk about.

What would a ten year younger you think of you now? What advice would you give to that person?

I tried plenty of those self-optimization and productivity tools. I would tell myself to just not care about all of that and not stress out about (productive) procrastination.

How I Fail S02E08 – Jen Heemstra (PhD’05, Chemistry)

Jen Heemstra is an Associate Professor of Chemistry at Emory University. Research in the Heemstra lab is focused on harnessing the molecular recognition and self-assembly properties of nucleic acids for applications in biosensing and bioimaging. Outside of work, Jen enjoys spending time with her husband and two sons, as well as rock climbing, cycling, and running. You can find out more about her and the members of the Heemstra Lab on her website or on Twitter.

Hi Jen, thanks for joining How I Fail! Next to your official bio, could you say a bit more about yourself?

Hi Veronika, 

It’s great to join you to talk about failure! This is a topic that I know well. From my 8th grade teacher telling me I wasn’t good at science to the grant proposal that was rejected last month, it is a topic that has significantly shaped my life and who I am as a person. The “unofficial” bio is that I’m someone who never thought I could be a scientist or a faculty member, so I still wake up every day in awe of where I am. And, while most people would call me a scientist, at this point in my career, I see myself more as a mentor and leader – science is just the vehicle for me to empower others to build their careers. To that end, my favorite thing about my job is getting to work with all of the students and postdocs who are my colleagues in the Heemstra Lab. People who know me on Twitter also know that I’m pretty outspoken about changing academic culture.

What’s a memorable failure for you?

Probably the most impactful failure of my career was my tenure vote at my former institution. It was not an outright failure (and I did ultimately get tenure) but it did not go as I had expected. It was definitely the most painful failure of my life, as I felt like I had let down my family and my research group members – basically all of the people I care most about. For anyone who hasn’t experienced that, it is a truly horrible feeling. But, it can also be a beautifully humbling experience as well. Seeing how all of those people stood by me in the midst of the struggle ended up seismically shifting my worldview and priorities. It gave me a new view of what academia could be and a fire to make that into a reality. It also made me fearless. This specific failure that I had long been afraid of ended up happening to me. It was the exact thing that I had deeply dreaded, and I found myself suddenly thrust into it and with no choice but to cope and keep moving forward. As I continued to work hard and succeed in spite of that and eventually came out of the situation, I realized that I’m stronger than I ever thought I was and that people’s opinions of me don’t have to define me.

On Twitter you have “embrace failure” in your bio. What does failure mean to you? Is there a story that made you add this line?

This is actually a phrase that I think about quite a bit and I’m not sure if I will always “embrace.” As researchers, we often talk about failure being a necessary part of the discovery process, but at the same time we know that we all need at least some success to move forward. As we’ve gotten involved with research on the psychology of failure, I’ve been able to better understand this dichotomy. Where I land right now is recognizing that failure is not inherently good, but rather being willing to fail can make us more likely to succeed. For example, if we are willing to dive into the hard experiment that might kill a project rather than saving it for the end because we’re afraid of the failure, we are ultimately more likely to advance our research in a meaningful way. All of that being said, the character limit for a bio on Twitter is pretty limiting, so I’m guessing I’ll keep the phrase there.

You are quite outspoken about various problems in academia. Can you say a bit more about how you got started with this? 

People who know me know that I’ve always been outspoken – Twitter and other media have just given me a public platform for sharing my thoughts more broadly. The motivation for talking about academia comes from realizing that early-career researchers should be at the center of all that we do in the context of academic research – after all, we work at institutions of higher education, not institutions of higher productivity. However, we have a reward system that primarily focuses on publications, grants, and awards, and this unfortunately can allow faculty to thrive in their own careers even if they don’t support the researchers working in their groups. I feel a responsibility to address this, not only by growing my own mentoring and leadership skills so that I can create a healthy and supportive culture in my own lab, but also by advocating for wider scale change.

Should everybody share failures, and/or be more open in general? What would your advice be for somebody who wants to be more open, but is afraid of the negative consequences?

This is a tricky one. I think we should have a culture in science and academia where people can be open about their failures without consequences. But, until we get there, I’ll say that our responsibility to share our failures is proportional to the amount of power we have in the academic system. For tenured faculty, when we are willing to share there is very little to be lost, but much to be gained in encouraging and supporting the next generation of scientists. I’ve also found that when other people are authentic about their failures, it actually increases my respect for them, rather than decreasing it.

Is there anything that you are currently failing at yourself?

As we stretch into month 8 of the COVID-19 spike in the US, am I allowed to say “everything”? I know it’s not true, but it’s tough to not feel like I’m simultaneously failing as a leader, teacher, mentor, and parent. There is more than ever that needs to be done, and trying to get all of that done in the online environment is often far less effective. And, the stress of everyday life right now makes it more challenging to show up and be the person that I want to be.

What types of things – successes or failures, big or small – do you keep track over time? Why / how does it help you?

That’s a very interesting question, and it makes me realize that I’m probably not great about doing this. I definitely keep track of my growth in key areas such as communication and leadership, but I tend to celebrate the successes and mourn the failures in real-time, then let them go and keep moving. For me, the more important questions are “did I improve myself today?” and “did I improve the world around me today?” and those are often agnostic to failure or success. That being said, part of my job as a faculty member is to fill out an annual report where I cut and paste every publication and talk into a website to be tabulated and analyzed by my institution, so I guess I do sort of use that to keep track.

Should we be sharing more of such (small, non-traditional) successes and failures too? 

I think this is incredibly important. We tend to define success and failure pretty narrowly in academia – the experiment worked or it didn’t, the paper got accepted or rejected, the grant got funded or not funded, etc. In our education research, we define failure as “not achieving a desired outcome” and that can look like many things – it can be not having a conference talk go as smoothly as you wanted or feeling like you didn’t handle a crucial conversation well. Along the same lines, the successes that we should celebrate are also much broader and we’re missing out by not recognizing those.

What is such a recent, small success for you?

I cracked a joke in an email this morning that made someone laugh. We all need laughter right now.

Are there any resources on failure you would recommend to early career researchers?

The book I most highly recommend is Mindset by Carol Dweck. It’s not directly about failure, but rather about how we view our abilities. However, her research suggests that this deeply impacts how we view failure, and ultimately, how likely we are to achieve success. Even more importantly, I’ve found that her research can hugely impact my happiness and sense of satisfaction in my work, and that is even more important to me than the classical metrics of success.

What would a ten year younger you think of you now? What advice would you give to that person?

Ten years younger me would think “No way! It is absolutely impossible that you are doing this.” I spent way too much time thinking that I could never have the career that I do, and I’m constantly amazed that I’ve made it here and have the opportunity to help others identify and work toward their career goals.

The advice I would give to ten years younger me is twofold: (1) it’s easier to live with failure than regret; (2) go out and find yourself some leadership skills – you’re going to need them. The second one I say somewhat jokingly, but also being completely serious. We tend to view academic jobs as “research jobs” while at the same time they require skills in people management, budget and finances, conflict resolution, strategic planning, etc and there is little in the typical trajectory that prepares you for that. But, that’s also why I’m writing a book! It will be all of the leadership advice I wish I had when I started my faculty career.

A song about academic rejection

So far I’ve only used YouTube to share talks, for example about my research or failure in academia. Today is different, because I’m proud to share with my latest project – Jolene, a song about academic rejection!

I wrote the lyrics back in 2017, and several people on Twitter suggested I should also record myself singing. The idea sounded great but I was also too scared of even trying.

Image

But 2020 is the year this changed! After Matt Wall shared his MRI song (a cover of “You shook me all night long” by AC/DC), I talked to him about an academic version of Jolene. As things often go on Twitter, turned into a project! Having another person involved made it easier for me to actually get it done, and Matt’s music & production skills made me confident enough to share this with all of you 🙂

Please enjoy Jolene – a song about academic rejection!

How I Fail S02E07 – Florian Dubost (PhD’20, Medical Image Analysis)

Florian Dubost is a postdoctoral researcher at the Laboratory of Quantitative Imaging and Artificial Intelligence at Stanford University, School of Medicine. His research interests include deep learning, neurology, medical image analysis, weakly supervised learning, and interpretability of neural networks. You can find out more about him on Google Scholar, LinkedIn, and on Twitter (@fpgdubost).

Hi Florian, thanks for joining How I Fail! Next to your official bio, could you say a bit more about yourself?

Hi Veronika, 

Thank you for inviting me! We know each other since a few years already, so you probably know already some of those details, but I will give a fresh reminder, at least for the rest of the audience! I am a 27 years old French man, who grew up in the suburbs of Paris, I have studied in a few places in Europe (France, Germany, Netherlands) and the US, and I am now located in the bay area. I am very interested in science and art, and I love to take up new challenges. I learnt to dance argentinian tango and recently to paint with acrylic. I really enjoy being able to focus both on science during my working time and art during some of my free time, which provides a very enjoyable balance. Many people would say that I am quite talkative. I like to tell and hear little stories, make up fun theories, debate with people, and when appropriate joke a lot! On a more serious note, it is very important to me to feel that my actions have a positive impact on the world, and trying to increase the magnitude of this impact is one of my most recurring motivations.

What are some memorable failures that stand out for you?

One of my most memorable failure was at the beginning of university, more precisely, while studying in those competitive French preparatory classes. I had just arrived home after completing a math–the most heavily weighted subject–exam. It was pretty easy, I prepared it well, and managed my time well during the exam. Though, after coming home, for a second, I had a doubt about a minus sign in the equation. I quickly checked the equation again, and realized I was wrong. Because only correct numerical results count, it turned out I had zero points, just because of a tiny mistake. I had never had a zero grade before. Before preparatory classes, I never even got lower than 10/20 (20 is the maximum in the French system). In preparatory classes, and I am going to explain that in a bit later, I was used to have 3, 4 or 5 out of 20. But 0, that was another realm I had until now not entered. You have to be pretty bad to get zero, even the worst students managed to grab one or two point here and here. I was striving hard, the hardest I had ever tried in my life, and I would get a zero grade. I think I did cry.

I have another example of a memorable failure, this time not involving intellectual abilities, at least directly. When I was teenager, I liked to do acrobatic stuff with my bike. Once, at a friend’s place, there was this sort of elevated area of the garden, which was separated from the car’s pathway by a little wall. I thought it would be fun to bike on the elevated platform until the wall, gain speed, fly a few second on my bike, and majestically fall back in the car’s pathway, concluding the whole act with a little back wheel drift. Sounds amazing, doesn’t it?! The car’s pathway was made of gravel, and I had never done something quite like this before. I hesitated a bit, but the idea was so marvelous, I had to try. I biked on the elevated platform until the wall, slowed down because I was afraid to fall, the bike did not fly, I fell with my head forward into the gravel, and the bike fell on me. Luckily I had a helmet. My friend removed the bike, sprayed alcohol in my back, where the gravels had left their marks, and I remember this being even more painful than the fall itself.

Conclusion: if you are going to try something risky, accept the negative outcome before it happens, and go full in while attempting if you want to have a chance to fly.

I could add to this my experiences with articles rejected after major revisions for factors that I could not control, and other kind of academic failures, but you probably already know the story yourself.

What is your definition of failure, and what kind of experiences do you think shaped this?

My definition of failure is when the results of my actions do not reach my expected outcome. It is personal by essence. You only fail in regards to your own objectives, so ultimately you are the one deciding for yourself what event is a failure. If you try something that has a low probability of success, and it ends up not working, I would not consider it as failure because I expected it not to work. If on the contrary, if I was sure it was going to work, invested my resource in proportion and had it not working, I would consider it a failure. But even then, a failure can be turned into a success. You can learn from it, try again and have it work. A real failure is a failure that stays a failure. Though one must also be wise, and step back on when things becomes doomed to fail. Errare humanum est, sed perseverare diabolicum.

I think my experience in preparatory classes shaped this personal definition of failure. The teachers keep trying to get more from you, you cannot satisfy the requirement completely as they are limitless. So there is only one way to be satisfied with what you accomplish: set your own threshold and objectives, and meet them. The system is here only to help you after all, not to judge you. You’re the only one allowed to judge yourself.

Can you explain more about these classes?

It is more subtle than this. Only top ambitious high school students join preparatory classes. You used to be the best of school, and you’re thrown into a class slightly bigger than that of your high school, everything is similar on the outside, but the other students are all as good as you are. They came from all French speaking countries in the world to compete against you. During two years, these classes prepare their students for national competitive exams, where only the best will be accepted in the most renown schools, which often have not much more than 200 places per year.

It does not matter how good you are, you have to be better, better than the others. Your grade on its own says nothing. There is no pass, there is only ranking of your grade in comparison to that of the others. You do not have time to lose, you must learn and be better than the others. And everyone does that. Forget staying at your parents’ place for emotional support: having more than one hour travel to the school will make you fail. Others tried before, after a few months they either moved closer or quitted. You are warned that it is difficult before you join the school. There was even a suicide once. Most high school student do not even dare to apply. The exams last sometimes 5 hours. They are not made for you to finish. Very few students manage to even read all questions. The difficulty is scaled for you to fail at some point. Your grade will measure how far you went before failing. 

Also, there are oral exams. Three hours per week, three different subject. With two other students, you go in a little room with three small blackboards. The teacher sits in the middle, make you pick a random exercise and let you solve it on the board. The exercise is designed for you to fail at some point. If you don’t, the teacher will come up with new, tougher, questions. The teacher will pick up any mistake you write on the board and lower your grade. The teacher will make you admit everything you don’t know or remember. During all this time, the teacher will judge your abilities and your commitment, which he eventually quantifies with a grade. 

For the written exam, the teacher gives back the exercises by order of ascending grades. The first one to be called is the worst. The teacher makes a comment about how the bad student was. Often this student cries. Remember, this student is a top student from a school somewhere in France. Then comes the second-to-worst and the story repeats itself.

No matter how good you are, things are programmed for you to fail, and measure how far you went. They are designed to check whether you can resist to constant pressure during two years, and still perform well.

At the beginning, I was afraid and insecure. I felt bad not being able to reach higher than 3 points out of 20 in my math exams despite working all the time and hardly sleeping.

After a while I took a different approach. I ignored the judgement of teachers and others, set my own objectives, was satisfied if I met them, and took the time to relax, spend time with friends and explore the city, Paris. I even followed theater classes. I used failures a boost. My grades went up, and I often got good ranks. After two years, I failed miserably at the exam of the school I was targeting. Luckily, I was very good at another equally good school, which I had not even considered. I joined that school and did cool stuff there. There are so many paths to success that failure may be nothing more than a mere distraction.

You mentioned moving around in academia, which many early career researchers are expected to do. Do you think this can create some inequalities further down the line?

I have moved quite a lot during my education. I left my parents’ place at 17 to join the prepary classes mentioned above. I had no friends around to support me through hardships. I made a few friends there, and had to leave them after two years, when I moved to my engineering school in the south. And the process repeated itself about every two years, joining even further places, foreign countries, which language I did not fully master. I had to build new friend groups as I moved, and tried to keep contact with my best friends via Skype.

My experience in preparatory classes had already made me very independent and resistant to stress and failure. I would even say that in comparison, normal life seems pretty easy even when dropped alone to the other side of the world. With the experience of moving, I became increasingly better at identifying potential new friends and create strong bonds rapidly. Moving may have even improved my social skills. Besides, I also like to move to new places. It feels like an new adventure awaits. I like the challenge of building things from scratch somewhere new and try to have an impact there. Though most people are not like this, and I sometimes find it hard to relate to locals.

Academia often expects young researchers to prove that they can perform well more than in one setting or institution, as it gives additional evidence that the researcher himself/herself substantially contributes to the success of the academic projects. On the other hand, I have in mind many examples of very successful researchers who stayed in the same university or only moved once to a university less that one hour away from their former institution. I guess that moving can give you a plus, but with current communication technologies, collaborations between institutions are easier to implement and one does not necessarily need to move to prove their skills. I move mostly because I like it.

Follow up question: do you think everybody is able / should do this, or maybe there are some other factors to consider? For example people with family

I do not think everyone is able move around like this. Some people are more bound to their friends and relatives, have a hard time making new connections or are simply afraid of change. I actually even think most people are. The other question is: should they move around? If it is going to negatively influence their health and productivity, I do not think they should. It is in their own best interest, that of their employer and, most importantly, that of the society they work for to be in an environment that is most comfortable. I understand that some people may not want or even be able to move around, and I do not think they should be forced to.

Often early career researchers are hesitant to join this series / share their failures, do you think there could be downsides to this?

I would assumed that some people could think about their failures as weaknesses. I do not think they are. Everybody experiences failures. There are inherent to one’s improvement process. If you show that you can handle failures well, and learn from them to become better, it actually displays strength. I assume that some people may also just not want to display their emotions online in general, I understand that.

Of course, they will always be people who disagree and think that failures are weaknesses. I would not worry too much about what those people think about me. If you want to accomplish great things, you face challenges and sometimes fail. If you never fail, it probably means that you could be trying harder.

What do you think about sharing data and code online, does it relate to experiencing or learning from failure in a way? 

I share what I am allowed to by my organization. I am for sharing code and data in general. But I also understand institutions that do not, and may need to keep monopoly on their data and code depending on their business model or research objectives. I think it is nice that both systems can coexist. As an independent researcher, I think the question is not whether you should share or not your data and code, but rather what part of it and when? I think most people do not share code, not necessarily because they are afraid of others stealing their idea, but rather because it takes time to clean your code and make it useable by peers and this investment is sometimes perceived as having a too low return by the authors.

Is there anything that you are currently failing at yourself?

Well, I am going as fast as I want in my research and I don’t have as good results as I want. But can you really consider that failure? That is simply research and that is what motivates me. Also, there is this company I did this summer. It does not work very well, or maybe even not at all. I am not worrying too much about it. I knew it was challenging and temporary. I gave it a shot, learnt a lot, and I will aim better next time. No big deal.

Do you keep track of failures and why/why not? Other than your CV, do you keep track of any positive things? 

I don’t keep track of failures. In general, I just don’t look at the past very much. I spend most of my time thinking about the future and how I can make as efficient and interesting as possible.

I like to create little portfolios of what I create or write, but I rarely keep it up to date. For example, I made an academic website to list my academic achievements, and I made an instagram account to gather my best paintings. I usually reflect back on it either when I am creating something similar, as a starting ground, or when sharing it with friends and family. But I do not spend very much time organizing that and rather spend the effort into making something new.

What is such a non-traditional, recent success for you?

I painted this, and it came out better than I had anticipated!

If you’ve been a reader of How I Fail last season, what are your favorite lessons from the series?

It is just reassuring to see that even the bests seem to fail at many things, and reinforces the idea that failure is a part of the path to success.

What would a five year younger you think of you now? What advice would you give to that person?

He would definitely be proud, maybe a bit intimidated and mostly probably curious about my path. He would probably be very impatient to ask questions. I am most of time pretty satisfied and excited with anything I do, though, I have to admit, others often do not become quite as excited as I do. So there is definitely some bias here.

My general advice would be: do what you like and what you think is interesting and fun, and do it well, put the effort in it, think strategically, use all resource you can leverage, and use failures to leverage success. And try a lot of different things, sometimes it fails, sometimes it works. Learn from the failures and move on, eventually only the successes will be written on your resume, so who cares about the failures? Just keep doing things, that’s how the boat floats.

How I Fail S02E06 – Danielle Navarro (PhD’03, Psychology)

Danielle Navarro is a computational cognitive scientist and Associate Professor at the University of New South Wales. Her research focuses on human concept learning and reasoning, and on statistical methods in the behavioural sciences. Other topics she has researched include data visualisation, decision making, language and cultural evolution, cognitive development, and forensic psychology. Danielle is a cofounder of R-Ladies Sydney and a member of the Board of Reviewing Editors at Science. On occasions she has been known to masquerade as a statistician and a generative artist.

Hi Danielle, thanks for joining How I Fail! Next to your official bio, could you say a bit more about yourself, and what made you join this series? 

Hi Veronika, 

Well, first, thank you for inviting me! As for why I decided to join, that’s easy – it’s a fabulous series and one that I think makes a real difference to people. I’m not sure what to say about me. I’m 43, I live in Sydney, I have two children who I love dearly and am endlessly perplexed by. I spend too much time on twitter for my own good, I’m openly transgender and bisexual, and I have a bad tendency to be honest about the difficulties I’ve had in coping with severe depression and anxiety. 

What’s a memorable failure for you?

Some of my failures are the same as anyone else’s in academia. Some papers get rejected, some grants don’t get funded, some experiments don’t work, some theories don’t work, some derivations are too hard for me to solve. Others are the same as anyone else’s in life. Those have been little things like when a job prospect didn’t work out, big things like when relationships failed, or terrible things like watching helplessly as someone I love died and I could not help. Life is necessarily filled with failure for all of us. I have no special insight into those failures and I don’t think I have anything much to say about them.

I do have one failure that stands out in my mind: I have failed dismally to convince my academic colleagues in psychology to take transgender rights seriously. It’s an odd failure because it’s one that doesn’t seem like it should be so hard, but it has proven to be entirely beyond me. I persevere with it because it matters to me, but I do not believe anything I say or do will lead to success.

I hope you don’t see this as a personal failure, but one of academia (or perhaps, this specific community? 

I honestly don’t know. On the one hand, sure, I can hardly be personally blamed for the fact that my colleagues are quite obviously doing nothing useful in regards to the problems facing transgender people. They are responsible for their behaviour, not me. On the other hand, it is a task I have set myself, and for good reason. The empirical data around transgender lives is extremely grim, and psychology as a discipline is partly to blame for that. We are the exact group of academics who create the diagnostic categories that govern transgender lives, and it matters to me that we as psychologists take responsibility for that. To that end I have written various blog posts, been open on twitter about some of my most painful experiences, done workshops, given talks, and… none of it makes any difference whatsoever. Regardless of where fault lies, I have failed at something I care deeply about and that hurts.

Is the situation changing? And are there differences between different fields, countries etc (perhaps some are more open to change than others)?

I think it is changing, if you look at it on a long enough time scale and from a great distance, you can see that it is genuinely improving. But I’m reminded of John Maynard Keynes quote about economics: 

> “The long run is a misleading guide to current affairs. In the long run we are all dead. Economists set themselves too easy, too useless a task if in tempestuous seasons they can only tell us that when the storm is long past the ocean is flat again

The situation regarding transgender rights is rather like this. Here and now, trans folks find ourselves in a storm. We can see signs that some countries are taking our concerns seriously. Some academic fields are showing signs of change, others have turned our lives into an ideological battleground. Even in the time I’ve been out, I’ve seen some positive steps: journals are becoming more open to the idea of allowing transgender people to edit names on older papers so that we no longer face the risk of being outed every time our work is cited. That’s a positive step, and one I am grateful to see. In the long run, I like to hope that trend will continue. But that is the long run, and in the here and now, I have to live in a very unpleasant world. 

What do you think about the CV of failures?

I have mixed feelings. I think it is a great idea to be open about failures and the CV of failures idea is a cute way to do that. At the same time, I sometimes feel like people look at one and think the takeaway message is “See, it’s a stochastic process! Just persevere and eventually you’ll get there!” I’m more pessimistic than that. Sometimes success and failure is not random. Sometimes you fail because the dice are loaded. And the thing is, per Leonard Cohen, everybody knows. Yes it really is a noisy process, but it’s also an unfair one. Biases are baked into academic (and other) systems, and that means that “luck” is unevenly distributed.

Are there any other popular opinions about failure that you disagree with? 

The biggest one I disagree with is that there is always something to learn from failures, some way you could do better next time. Often that is true. Sometimes it is not, and you can drive yourself a little bit mad looking for something positive. When that happens, I think it is okay just to say to yourself, “yep, that failed and I have absolutely no idea how I could do it better.” 

Can you think of any examples where somebody failed and said that, that we should be learning from?

Ha! My Ph.D. advisor once said to me that it was okay to make mistakes, just try never to make the same mistake twice. Or words to that effect. In that case it was prompted by something where I’d accidentally breached confidentiality (thankfully it was a minor breach and I was able to repair the error) and it was genuinely great advice. What I took from it was it’s okay to fail but always learn from it so you can do better next time. In most cases, I absolutely think this “learn from error” approach is the right perspective, but you can take it too far. Sometimes life just doesn’t give you any useful training signal, sadly.  

Do you think the uneven distribution of luck also influences whether people share their successes?

I think it does. It’s easier to talk about failure when you feel secure, I think, and it’s hard to feel secure when you are living in a low-reward environment. I find it easy to talk about rejected papers and grants because I’ve had quite a bit of success there. Oddly, I find it harder to talk about the successes I’ve had in that area because I’m acutely aware that not everyone has had my good fortune, and not everyone has been afforded the opportunities I’ve been given

Omg yes! It took me until the end of my tenure track to just properly introduce myself as an assistant professor 

🙂

But why is that, are we not biasing things in a different way somehow by “hiding” successes? Because you know the demographic vocal about theirs

Well, yes, in a sense this is true. Members of some demographics seem to be … less shy than others, shall we say? … about broadcasting their success to the world. That has the effect of biasing the observable data of who is seen to be succeeding. Perhaps those people could be quieter? 

But I think there is also a serious point to be made about the reasons why we choose not to disclose. I’ll use myself as an example, and I’ll use “cisgender white men” as an example of a demographic that is, on average, not so shy about talking up their successes. Suppose I were to “act like a man”, be bold and assertive and unabashedly proud of my success the way that (some, not all) men tend to. What are the political and social consequences for me – a transgender woman – for acting like a man? I hope I don’t need to spell it out in a lot of detail, but the fact of the matter is that this is simply not a viable life strategy for me given the world that we live in.

What can we [everybody, individually] do more structurally to change things?   

Little things come to mind. An easy one is to learn the art of not treating other people’s lives as interesting intellectual exercises. Do you as an academic really need to have a public discussion about the metaphysics of gender – does it actually matter whether I am “really” a woman, for example? Does it serve a useful scientific purpose to speculate about the “causes of transsexuality” as so many psychologists have done? What possible reason do you have to care about this, and why does your personal interest in the subject override the preferences of the people whose lives you are interfering with? Asking yourself these questions before deciding what studies to run, thinking about them when reviewing papers on sensitive subjects, and thinking about the real world consequences for other people when making editorial decisions seems like a good idea. Yes, good science requires open discussion, this is true. It also requires prudent discussion because science takes place in the real world. 

Hm, I’m not sure that’s exactly answering the question! I guess what I’m trying to say is that when other people’s lives and wellbeing are at stake – as is the case when talking about transgender subjects – maybe show a little care and kindness when deciding which particular hill you want to die on?

Have you shared things about failures online before? You mentioned sharing painful experiences, without any effect? 

I’ve written about painful experiences. Writing helps me get through hard times, and it can be valuable to look back at what I have written. My favourite example is 52 pickup. It’s not uncommon for me to feel badly about myself as an academic, because I am not as productive as I’d like to be, and I struggle to stay on an emotionally even keel. My first instinct is always to blame myself for this, but every time I re-read that piece, it reminds me that there genuinely is something bizarre about trying to survive in academia as a trans woman, and that the strangeness of it all isn’t entirely in my head – a lot of it comes from the structure of the environment. Keeping that in mind helps me be a little kinder to myself when I inevitably fail to meet my own expectations.  

Do you keep track of failures in other ways, as you would for a CV? Do you keep track of other things (habits for example), and what is the difference?

To be honest, I don’t even keep a CV of successes. I probably ought not say this but I cannot stand academic CVs, whether they be a list of successes or failures. All my friends in industry find it hilarious that we keep these massive documents exhaustively listing ALL THE THINGS. It’s kind of absurd. My CV is, quite deliberately, only two pages long. I am trying to make myself take the same approach to failures: there are some big ones I want to remember, but honestly if I kept an exhaustive list I’d probably just keep reading it over and over and ruminating on them. 

As for other things, I obsessively track the number of days I have been sober (currently 523), I track my running, I track my artwork, and a whole lot of other things besides. I seem to get a lot more value out of that kind of tracking than I do with tracking work related things. I’m not sure why that is.  

Tell me one recent success, and one thing you are “successfully failing” at 😀 

My favourite recent success is art-related. Over the last year I’ve gotten really interested in making generative art in R, and I’ve posted a lot of my art online. An example that always makes me smile is the “heartbleed” series, consisting of images like this

Besides the intrinsic reward I get from making art, I’ve become a much better programmer because of it. I’ve taught myself the basics of C++ so that I can call compiled code from R, I’ve spent time thinking about API design for packages, I have ended up writing my own blog themes that integrate nicely with R packages like blogdown and hugodown, and so on. It’s a personal success that has given me some professional benefits. As for “successfully failing”, I am doing a spectacular job at failing to get over my fear of sending my R packages to CRAN. It’s becoming quite silly.

Are there any art things, books, resources etc. you would recommend to the readers?

You’d think I would be able to think of some, but weirdly nothing is coming to mind. I don’t read art books, and I’ve never really gotten much value from motivational books etc. But I am a big fan of reading tidyverse documentation, any of Hadley Wickham’s books about R, and I spend a lot of time looking at other people’s art and try to figure out how they created it. I find anything by Kate Manne super helpful in making sense of some of the inequalities I see in the world. But more often than not I prefer to just re-read Terry Pratchett novels. 🙂

If you’ve been a reader of How I Fail last season, what are your favorite lessons from the series?

Greg Wilson’s quote: “Be kind, everything else is detail.” 

What would a ten year younger you think of you now? What advice would you give to that person?

HA! He might be a little shocked. I think I might have to spend a bit of time calming the poor boy down and explaining some of the facts of life to him. Mostly I’d suggest that it’s okay to be honest about your fears, your hopes, and that you’ll find a way through what is about to be a very strange decade for you. 

Guest post: A CV of Failures in Data Science

As I recently shared on Twitter, my husband Mattias Hansson recently found a senior data science position, after a year long job search process in The Netherlands. He doesn’t really do social media, but you can see his profile on LinkedIn. In this special guest post, I invited him to share something about this process.

[The text from here on is from Mattias’s perspective] 

A bit about me

I grew up in the forests of Sweden in the region of Småland, but I was born in the capital Stockholm. I received a master’s degree in Mathematics from Linköping University, and a Ph.D in Mathematics from Lund University. The title of my Ph.D thesis is ‘Statistical segmentation and registration of ultrasound data’. I did a post doc at the University of Copenhagen at the Department of Computer Science, where I constructed algorithms for defect detection in lumber (a collaboration between university and industry). During my time there I met Veronika, and in 2015 I moved to the Netherlands where I started working at Erasmus Medical Center in Rotterdam as a scientific programmer and researcher. I worked on setting up infrastructure for imaging genetics research, as well as doing research. Additionally I have briefly worked in digital marketing and with my own company. 

Currently my interests are primarily in computer vision, machine learning and statistics. I love to dig into the mathematical details. I am an old rock-climber (20 years experience), but since my shoulder started bothering me I have now transitioned to long-distance walking and running. I love beer festivals and I used to travel every year to Germany (yes, I own a pair of lederhosen), even though this seems like a thing of the past. We also love BBQing, which fortunately we were still able to do during lockdown. 

My job search

I started my job search in November 2019, with the pandemic hitting a few months later. In total I estimate I applied to at least 50 positions, but probably closer to 75 positions, since I didn’t always keep track and never heard back from some applications. Most of these were data scientist positions, unless mentioned otherwise.

  1. Roamler International
  2. FindHotel 
  3. PlotWise 
  4. Amsterdam Data Collective
  5. ABN Amro – Junior Quant
  6. Gemeente Amsterdam 
  7. Quantillion Technologies 
  8. Werkspot
  9. WCC 
  10. Catawiki 
  11. Domino’s Pizza 
  12. Ydigital 
  13. Erasmus MC – postdoc
  14. TU Delft – postdoc
  15. TU Eindhoven – postdoc
  16. Achmea
  17. ASML
  18. Danone
  19. DSM
  20. Elsevier
  21. e-Science Center
  22. Fugru
  23. Numbrs
  24. Quades
  25. SwissRE
  26. Tripaneer
  27. ViQtorDavies
  28. Wikimedia
  29. Aon
  30. CoolBlue
  31. Adyen
  32. Alt
  33. Beat
  34. Bol
  35. CasparAI
  36. Exact
  37. Greeniant
  38. Itility
  39. NCCGroup
  40. RijkZwaan
  41. TU Delft – scientific programmer
  42. Geronimo AI
  43. Lely
  44. PrimeVision
  45. Qualogy
  46. Riviq
  47. Agro
  48. LINKIT
  49. WinBee
  50. Forecast
  51. Mollie
  52. Huawei
  53. MyTomorrows
  54. Priva
  55. Agap2IT
  56. EMEA

There were a number of bad experiences, which I summarize below. 

Problem 1: Level of interviews

Something that happened in several places is that all interviews were conducted by somebody without a mathematics/computer science background. At one company I had 5 interviews, of which 3 on-site. These were led by a consultant which said some incorrect statements about mathematics, and did not appreciate me correcting these. 

At a start-up, I was quizzed using typical “Google interview questions”, and they expected that I would know many of these answers by heart. Of course, the salary was nothing like at Google. A similar thing happened at a large financial company, where I was expected to answer a question about a specific bug in a Python library. 

Problem 2: Profiting from your work

Other companies had a more fitting process, involving some kind of take-home programming assignments. These were interesting, but would take me 2-3 days each. Some of these companies then completely ghosted me, even though I’ve had several interviews. I’m also suspecting that some companies use this to get free quick solutions to their problems (these were not entry-level programming assignments). 

I’ve also only had bad experiences with recruitment consultants, who promise to find you an assignment and call every week, which costs you time, but never gets you anything. It’s a mystery to me how they stay in business. 

Problem 3: Not honoring agreements

Several companies ghosted me after having several interviews, or would only get back to me weeks or months after what was agreed upon. The most memorable example is a multinational company where we had agreed I was interviewing for a mostly-remote job. Once I had finished the interviews and assignment, they announced they wanted me to move to a different country anyway.  

Lessons learned

If I had to do this again, I would avoid recruitment consultants – they are the true definition of a waste of time.

I would probably apply to less jobs, and would step out of the process as soon as there were any bad signs. But I understand that not everyone is able to do this, and might need to take a job as soon as possible.

Maybe the best tip is to avoid the “sunk cost fallacy” – don’t think because you spent a lot of effort on getting a job, that you should stay there – things may still go differently.

***

Thanks for sharing your story Mattias, nice to have you on the blog <3

Mastodon More Mastodon
%d bloggers like this: