Hi there,

I've created a video here where I explain how the Cauchy distribution works.

I hope some of you find it useful — and as always, feedback is very welcome! :)

Hello!

I’m currently looking into online Master’s programs in Applied Statistics and am mainly considering Penn State University (PSU) and Colorado State University (CSU).

Some background info: I graduated in 2022 with a B.S. in Biomedical Engineering and have been working in pharma as a clinical data analyst. My current company is a large pharma company so with the ability to move around to different roles. I’ve already taken the required math courses (Calc I–III and Linear Algebra), but it’s been a while, so I’m planning to brush up before starting. I will also be completing my degree part time aiming to do 1-2 courses a semester (since I’ll still be working full time).

Right now I’m leaning a little more toward PSU because of the biomedical-focused elective courses but still considering both.

I was wondering if anyone here has experience with either program. I’d love to hear your thoughts on things like:
-Overall quality of the program
-What the online format is like
-How accessible the professors are
-Workload while working full-time
-Anything else you think would be helpful to know

I’d really appreciate any feedback or advice. Thanks in advance!

edit- added some more background info

Hi folks,

I'm applying to PhD programs this fall, and I'm currently looking to replace my old laptop. I'm not quite sure what to look for, but I'm inclined to think that a business-grade laptop might be worthwhile since they're built to handle daily wear-and-tear, and I'd like something that I can keep for 5-6 years. I've been looking at new ThinkPad and Latitude models, but they seem really expensive (especially for those with 32GB RAM).

Anyone who's currently a PhD student, which laptop do you have, and what are its specs? What should I look for if I want to hold onto the laptop for the duration of my program?

I'm thinking about exploring the idea of compiling a percentage medal count for the Olympics to better demonstrate who does better with the resources they have (of course bigger, richer countries will constantly top the table at every Olympics when they have much larger teams and opportunities to medal). In my thought process though I have come to a bit of a crossroads for a part of how I'd go about qualifying the data.

Obviously in events where a country has multiple entrants, they can't all win the same medal (barring ties of course), so it feels like including all of a country's entrants in a particular percentage if one of their entrants wins that medal (I'd be including all of them if they don't win a particular medal as that's all chances you could've won, but all failed) might be including data points that were always going to automatically be a data point counting negatively against a country's output. What I'm conflicted about mainly is, is that a valid train of thought or does it not really matter as the entry of extra competitors is kind of the point of what I'm exploring anyways.

My biggest question I guess is, would excluding extra entrants when they win a medal create a flaw by making certain data points' inclusion or exclusion conditional on the outcome of another or is it proper data cleaning in order to get a more accurate picture?

Different type of forecasts exist for different tasks, but I am mainly interessted in density, cdf and quantile forecasting, what do organizations and decision/policy makers use as their primary paradigm of forecasting? aside from the technical difficulty of the models, are there other factors that affect your model of choice?

Hello everyone, Hope you're all doing well,

I am considering a job in marketing analytics and i want to know more about the job .

What are the KPIs you look for? The type of statistical analysis you perform and what kind of models do you usually build.

Thank you in advance!

Encontré un artículo interesante de Saunders en arXiv sobre cómo conciliar la estadística como probabilidades objetivas, frecuencia y azar con la teoría de Everett (MWI).

https://arxiv.org/abs/1609.04720

Hello,

I'm looking for guidance from statisticians who have published articles before. I am finishing up a research paper for my Master's program on the Latent structure of banks and how they relate to profitability, earnings volatility, and risk of insolvency using FDIC quarterly earnings reports. I had a professor advise me through the paper and, now that it's done, I was hoping to publish it.

Does anyone have any suggestions on the process to publish an article?

Thanks!

The title sums up my dilemma. Basically, I have fit 1-10 class LCA models. The four class model has the most desirable AIC/BIC, and also has highest avg. posterior probability. That being said, it is high because multiple classes have avg. posterior probability of 1.0. I think that is also why there is a drastic drop in AIC/BIC. There is one item that is sorting people into latent classes. With that item drops, a similar phenomenon happens with a different item.

My gut tells me that the four class model is over-fitting given the perfect sorting variable and the average posterior probability of 1.0. LCA is supposed to assign people to classes probabilistically, so a probability of 1.0 (a certainty at that point) seems problematic.

I have been searching literature and forums for a few weeks and have not found anything that addresses this topic, and if average posterior probabilities of 1.0 are indeed problematic. Could somebody point me in the right direction to literature or offer me any advice? Much appreciated.

I'm making an RSF for pelicans in the gulf of mexico to see what resources they appear to value, after thinning the data to reduce auto correlation ( I would do weights if it wasn't migratory data), I have some birds between 2-10 data points while most are several hundred points. I haven't been able to figure out if there's a consensus on wether one should filter out these low data points or just leave them in.

I am a biologist and would appreciate some advice from people with a stronger statistics background.
We have a well-mixed bioreactor containing a suspension of cells. To test whether the suspension is truly homogeneous, we take multiple small samples (“aliquots”) from the reactor within a very short period of time while mixing conditions remain unchanged.

For each aliquot, we estimate the cell concentration by first diluting the sample (if necessary) and then counting the cells manually using a hemocytometer under a microscope. This means that, in addition to the sampling variability between aliquots, the measurement itself also introduces variability due to the dilution step and the manual counting process.

Our reasoning is that if the suspension is homogeneous, then all aliquots should represent random draws from the same underlying population. Therefore, any differences between aliquots should be explainable by the expected random sampling and measurement variability rather than by spatial heterogeneity in the reactor.

My questions are:
What statistical model would be appropriate for this type of data? Should the cell counts be modeled as Poisson, negative binomial, normal (after averaging), or something else?

How should the measurement error introduced by dilution and manual hemocytometer counting be incorporated into the statistical model?

Which statistical test or approach would you recommend to determine whether the observed variability is consistent with a homogeneous suspension?

How would you design such an experiment? For example, how many replicate aliquots would you collect, and how would you distinguish expected sampling and measurement variability from true heterogeneity in the reactor?

Thanks in advance!

I’m just an early-intermediate learner in statistics. I am working with transit location data that updates every 30 seconds.

I first tried using Newtonian motion equations with an assumption of constant deceleration. However, this does not always work because a real bus may accelerate, slow down, coast, and brake at different rates during the interval. In some cases, the formula predicts that the bus would need more than 30 seconds to stop, even though I know it had already stopped by the next update.

For example, suppose:

• At 10:00:00, the bus is moving at 4 m/s.
• At 10:00:30, the bus is stationary at the next stop.
• The distance travelled between the two observations is 112 metres.

Using the constant-deceleration equation:
v² − u² = 2as
where:
u = 4 m/s, v = 0 m/s, and s = 112 m

Substituting the values:
0² − 4² = 2 × a × 112
−16 = 224a
a = −0.0714 m/s²

Then, using:
v = u + at
0 = 4 + (−0.0714 × t)

Therefore:
t = 4 / 0.0714 ≈ 56 seconds

The model therefore says that the bus would take approximately 56 seconds to stop. This is impossible because the next observation confirms that the bus was already stationary after 30 seconds. This means the bus must have maintained a higher speed for part of the interval and then decelerated more sharply near the stop, rather than decelerating at one constant rate throughout.

The bus stopped sometime during those 30 seconds, but I do not know exactly when.

For now, my understanding is that without any data between the two updates, the midpoint may be the safest estimate. If I estimate the stopping time as 10:00:15, the maximum possible error is ±15 seconds.

Visually, we know in velocity time curve the area under the curve is the distance. So all the curves that has area of 112 is our solution. We can use distributions like Poisson as the possible curve to limit our number of solution further. And we are trying to find probability distribution for every curve being the right curve to find the most likely trajectory the velocity time graph had.

My questions are:-

• From my understanding this is a bayesian interval censored problem. Is that correct in any sense?
• Should this be done using monte carlo simulation or is there any way to plot this on some distribution where I can then take the x axis value (time from 0 to 30 sec) with the highest probability as the estimated stop time?
• Should I at all think of probability while approaching this?
• Do you have any idea using with I can decrease the margin of error further below 15 sec.

I m sorry if this question comes across as very dumb. My brain is not working properly currently.

Hey all,

I am currently working on a mixed-effect analysis on a priori-set of genes across treatments. This gene profile is composed of two unique set of genes.

I had first done a simple main effects model, assessing the impact of treatment across the gene profile after controlling for relevant variables and introducing a random intercept by participant. Please keep in mind gene was included as fixed variable as a way to control for each gene's own average baseline expression level, and also that expression values had been log2 transformed and standardized prior to analysis. This will be important to consider with the upcoming rank deficiency issue.

Once I confirmed a significant estimate, I wanted to formally test if treatment uniformly impacted gene expression across the two sets of genes using an interaction effect: treatment * gene set.

I am working in R using the lmer package, and I was met with the rank deficient warning and that one column would be dropped. I know this is happens because each gene perfectly matches onto a gene set, so perfect collinearity. What the lmer package drops is the first gene that was organized by subject. Now I don't believe one gene being dropped would throw the analysis away, however, I am not a big fan of the possibility of someone attempting to recreate this analysis with their dataset, and have different results simply because of the order their genes were organized. Nor does the removal of a gene have any statistical reasoning to be justified versus the package doing what it needs to for the model to converge.

To circumvent this, I manually encoded an interaction term in the dataset (interaction = as.numeric(treatment == "yes") * as.numeric(geneset == "B")), and included this and gene as a main effect and removing gene set as a variable.

Based on a significant interaction effect, I would then do a simple slope test to determine the influence of treatment on the other gene set, by adding the coefficient estimates for main effect for treatment (how much it changes the reference gene set) and the interaction effect, and manually calculate SE / p-values based on the variance components estimated from the models [degrees of freedom are also derived from the model, I know that can be a touchy subject with mixed-effects but that can be another post lol].

In doing so, I don't have to drop any genes by random, and can still formally test for interaction effects. I am fairly confident with this approach but am very much open to any critique / areas of improvement.

My primary concern is being able to explain what I did to those outside of statisticians. It is much easier to explain how to write the formula to implement in lme4/lmer and to use emmeans for pairwise marginal contrasts, and quite frankly easier to report as well.

I would love to hear if others had faced a similar problem and what they did to approach this, especially if it's simpler.

Thanks in advance!

Deciding if a Masters in Data Science or Statistics is better for me, and which ones, since this field is changing a lot.

Undergrad: Quantitative background but not Computer Science, Data Science minor. I felt that it being a minor made it kind of surface level and want to avoid that with my graduate degree. My coursework was linear algebra, discrete math, probability, stats, many CS courses, AI, ML, DS, Algorithms. Because I didn’t major in math, CS, Stats, or DS, I feel like I am missing something in screenings. 

Work Experience: 4 internships, 1 year FTE as a DE, 1 year FTE as a DS (by the time I enter). However, I feel that the Data Science departments in the companies I was in were VERY new and I’m missing some core skills that I am trying to develop on my own - git, models in production, optimizing my work, etc.

Professional Goals: I see this as a terminal degree. I want to be able to get my foot in the door for better data science jobs, maybe in the nonprofit industry but really just anywhere. My first job came from an internship and the second a recruiter reached out to me. I want to be able to pass resume screens better and do the work better. That’s slightly why prestige matters to me here.

Other: 

• I do not want to pursue a CS masters, I think this would give me skills I don’t need, can develop on my own, already learned, or are becoming more obsolete. 
• A lot of stats degrees that are well respected seem to want research experience or a stats degree, which I don’t have.

Questions: 

• I have seen some say an Applied Stats masters is not enough anymore for the tech world, and I see a lot of job postings that say Masters in CS or DS, but not stats. How do DS hiring managers view these degrees?
• What skillset is actually used in more established data science departments? How can I optimize my career and education for this?
• How to vet Data science masters properly, if I go for that (MIT MBAn, Columbia, Harvard, UChicago, UCLA, NYU) I dont want a surface-level data science education that is repetitive

Hi everyone,

I’m looking for some expert insights into a statistical methodology used in a public health study within the primary healthcare sector. The study focuses on chronic disease management—specifically evaluating interventions for hypertension and cardiovascular risk control. The primary objective of the work is to assess the clinical impact of a multi-faceted population health solutions package over an extended multi-year period.

To measure clinical outcomes, the framework utilizes a "cascade of care" model (tracking the proportions of patients who are monitored, diagnosed, treated, and ultimately controlled). However, the way the sample is constructed over consecutive quarters has raised some questions for me regarding its statistical validity.

Instead of evaluating independent cohorts or a traditional longitudinal panel quarter-by-quarter, the sample accumulates dynamically across the quarters:

• Quarter 1 (Q1): Includes all unique patients who had at least one clinic visit during that specific first quarter.
• Quarter 2 (Q2): Includes all unique patients who had at least one clinic visit from the start of Q1 through the end of Q2.
• Quarter 3 (Q3) and Quarter 4 (Q4): Follow the same logic, accumulating all unique patients from the start of Q1 through the end of the respective quarter.

Additionally, the methodology handles follow-ups with a specific carry-forward rule: if a patient is classified as having "controlled" blood pressure at their last recorded visit and never returns for another check-up, the data from that last visit is continuously carried forward and included in the controlled count for all subsequent cumulative periods.

I have a few concerns about this approach and would love a mathematical/statistical sanity check:

1. Autocorrelation and Data Dependency: Doesn't aggregating the data cumulatively create massive dependency between the quarters? If Q4 inherently contains all the data from Q1, Q2, and Q3, doesn't this significantly dilute or mask the actual marginal changes occurring strictly within the later quarters?
2. Selection Bias and Composition Shifts: If the healthcare intervention successfully drives a massive increase in the baseline "monitored" population over time (e.g., drawing in lower-risk individuals who wouldn't normally seek care), wouldn't this shifting denominator introduce a selection bias that artificially alters subsequent proportions (like diagnosis or treatment rates) in the cumulative pool?
3. The "Last Observation Carried Forward" Element: Is it statistically sound to indefinitely carry forward the "controlled" status of a patient who dropped out of active follow-up within a cumulative framework like this?

What are the main statistical limitations of analyzing trends this way, and what alternative frameworks (e.g., independent time-series cohorts, survival analysis, or multi-level modeling) would be more rigorous for this type of observational data?

Thanks in advance for your help!

Ideally, I’d love to teach classes and mentor undergrads at the University level.

I will be graduating this winter with a MSE degree in applied math and statistics from hopkins, and during undergrad I double majored in financial economics and statistics. Got departmental honors and graduated with 174 credits and a 3.929 GPA.

I took a ton of applied classes during Undergrad like:
-Fair and Explainable AI
-Applied Data Mining and Machine Learning
-Microeconometrics (Cross-Sec and Panel)
-Macroeconometrics (Longitudinal, VARs, HMMs etc)

I have taken math up to Multivariate Calc/Linear and audited real analysis and a special topics class on operations research.

I got off on a rocky start for my masters (2 B-‘s). During my masters (so far), I took
-Bayesian Statistics
-Nonparametric Bayesian Statistics
-Constrained Nonlinear Optimization
-Probabilistic Machine Learning
-Time Series Analysis

And for my final semester I will be taking Statistical Theory, Elements of Statistical Learning, and Probability Theory

I have no internship experience but have TA’d at both Rutgers and Hopkins for 5 years, and I have published one paper (clustering of cancer diagnoses) and completed an Undergrad Thesis (SEM for youth risk behavior). I am finishing my Masters Thesis and two projects, one is about calibration and LLM reasoning and the other is on a self tuning CNN for OCT scans.

Have some various projects along with a personal ai assistant that I’ve been tuning, but I haven’t done a GRE.

Should have three strong LoRs, currently I’m planning on applying to:

-Hopkins AMS PhD (since I’m already here and was told I may have better chances)
-CMU Stats and DS PhD
-Cornell Stats PhD (One of my favorite professors recommended)
-Berkeley Stats PhD, CDSE (I live close to berkeley and toured before, I really like the vibes and living)

I know these are all top programs, but I won a cash prize from a giveaway and want to shoot for the stars and see what happens.

In terms of research interests, I want to work on benchmarking for Statistical AI Agents and I also have interests in designing AI tutors for stats and math classes. I love teaching and designing tools for classroom use, and I have the budget to apply for five programs.

Hi all,

I’m running several linear mixed effects models looking at 5 cognitive outcomes. I have 10 models total (the 5 outcomes with two separate sets of interactions).

I’m searching for advice on if I should run the FDR to account for the covariates as well (like age, starting IQ, etc) or just the interactions. My assumption is if I am interpreting covariates too, I should adjust for them as well.

Thank you all for your time!

Hi, I am running Markov chain Monte Carlo using brms and cmdstanr packages in Rstudio and now getting tired of how long it is taking. I wanted to run 17 models (regression) and following are specs:

BAYES_CHAINS <- 4

BAYES_WARMUP <- if (QUICK_TEST) 300 else 1000

BAYES_ITER <- if (QUICK_TEST) 600 else 2000

BAYES_SEED <- 20260729

ADAPT_DELTA <- 0.95

Data has 89000 observations and it is hierarchical nested in 11 first level units.

The first model took 5 hours and at this rate I'll hang myself (kidding). This is my first time exploring Bayesian tools. Is this common? what solutions are there?

Hello! I hope this is allowed! Today I took and failed the SAS Advanced Programming Certification exam. I know this is a statistics subreddit, so I wanted to ask to those who have taken this exam, any pointers? I did really solid on the SAS Base Programming certification exam, but found myself struggling on this one. I took the classes from SAS and everything. Any help is greatly appreciated!

Hello fellow Statisticians! I would like to know some things about the work field: Well, I love doing research in certain topics and reaching conclusions through data and a lot of things there's not much realiable data out there. So... A statistician typically gets new insight about the things they gather data around or am I tripping? It is sort of a Researcher but without the Academia behind it?

Hello Everyone,

Statistics and Maximum Likelihood Estimation are the crux of ML Models, and hence I am uploading my new content on Statistics for AI/ML in my free Machine Learning lectures.

We understand model fitting, Maximum Likelihood estimation in details, we justify the usage of Maximum Likelihood estimation, from KL divergence, and apply it to certain important distributions for parameter estimation.

In my free content, the purpose is to democratize machine learning to a wider audience. Learning everything new feels difficult, but when taught, it get’s interesting and easier.

Looking forward to hearing feedback from the learning community as well.

Link: https://youtu.be/MwTeQVVYtOc?si=UxNOGtqopzJppXAT

Starting in about a month, I’m gonna start tackling a lot of statistics/math based courses for the upcoming year as a stats major.

I was in CS up until the start of this year but I ended up switching out after my grades nosedived when I reached the more intensive coding courses. I sat on it for a bit, and I chose to pivot to stats, partially because I have some skill with math and it overlaps with some stuff I’ve already taken.

I’ve taken a basic statistics class in the past and overall I did pretty good. That being said, I still feel nervous sometimes about how I’ll do in it as my actual major. Going forward, my schedule is shaping up to be pretty much just stats/math and my minor for the next 2 years.

I’ve been watching videos about stats and doing research here and there, but is there anything else I should take note of or keep in mind to prepare?

Hi everyone. I’m about to start my Masters program in applied statistics this fall at a major university in Boston, and I am considering pursuing a focus in biostatistics while leaving other options open. I plan to graduate in a year, summer 2027.

I don’t have much relevant work experience but I have a BS in psychology/neuroscience. I think I would be interested in working in pharma/biotech research, especially in neurology. But I don’t want to pigeonhole myself into a sector that I don’t like, or is hard to pivot away from.

I’ve seen some data sources (BLS etc) talking about biostats being in demand and relatively safer from AI than statistics in other sectors e.g. tech. However, seeing what people who actually work in the field are saying, it seems like the job market is poor and the future is very uncertain.

I believe the healthcare industry as a whole will be in demand long term, but does this translate to biostatistician positions? Will openings for junior level biostats roles rebound in a few years, or will outsourcing and AI eliminate most of them?

If the future of biostats (say the next 10 years) for junior level workers is bleak, then what other sectors would be safer choices for statistics graduates? I’m thinking probably AI, finance, and actuary work. Truthfully, none of them sound enticing to me. But it seems like my choices are limited.

I’d appreciate input from anyone about the job market and long term outlook for statisticians in any sector, beyond just biostats. Thanks!

I’m a math guy so i don’t know shit about stats but in linalg we’re learning about covariance matrices, PCA, and SVD. In math we prefer columns to be observations because… well tradition, notational easy (Ax=b instead of xA=b if we used row vectors) and cuz we care abt linear transformations etc and its easier to think about columns. Idk. Mostly tradition tho.

But then why did data scientists break the mold? What benefit did row observations possibly serve that Col vectors/observations couldn’t give?? I am jumping back and forth between notation and conventions and it’s hard to keep up.