title: VcT: Visual change Transformer for Remote Sensing Image Change Detection

abstract: Existing visual change detectors usually adopt CNNs or Transformers for feature representation learning and focus on learning effective representation for the changed regions between images. Although good performance can be obtained by enhancing the features of the change regions, however, these works are still limited mainly due to the ignorance of mining the unchanged background context information. It is known that one main challenge for change detection is how to obtain the consistent representations for two images involving different variations, such as spatial variation, sunlight intensity, etc. In this work, we demonstrate that carefully mining the common background information provides an important cue to learn the consistent representations for the two images which thus obviously facilitates the visual change detection problem. Based on this observation, we propose a novel Visual change Transformer (VcT) model for visual change detection problem. To be specific, a shared backbone network is first used to extract the feature maps for the given image pair. Then, each pixel of feature map is regarded as a graph node and the graph neural network is proposed to model the structured information for coarse change map prediction. Top-K reliable tokens can be mined from the map and refined by using the clustering algorithm. Then, these reliable tokens are enhanced by first utilizing self/cross-attention schemes and then interacting with original features via an anchor-primary attention learning module. Finally, the prediction head is proposed to get a more accurate change map. Extensive experiments on multiple benchmark datasets validated the effectiveness of our proposed VcT model.


title: Loss features in ultracold $^{162}$Dy gases: two- versus three-body processes

abstract: Dipolar gases like erbium and dysprosium have a dense spectrum of resonant loss features associated with their strong anisotropic interaction potential. These resonances display various behaviours with density and temperature, implying diverse microscopic properties. Here, we quantitatively investigate the low-field ($B < 6\,\text{G}$) loss features in ultracold thermal samples of $^{162}$Dy, revealing two- and three-body dominated loss processes. We investigate their temperature dependence and detect a feature compatible with a $d$-wave Fano-Feshbach resonance, which has not been observed before. We also analyse the expansion of the dipolar Bose-Einstein condensate as a function of the magnetic field and interpret the changes in size close to the resonances with a variation in the scattering length.


title: A note on an effective bound for the gonality conjecture

abstract: The gonality conjecture, proved by Ein--Lazarsfeld, asserts that the gonality of a nonsingular projective curve of genus $g$ can be detected from its syzygies in the embedding given by a line bundle of sufficiently large degree. An effective result obtained by Rathmann says that any line bundle of degree at least 4g-3 would work in the gonality theorem. In this note, we improve the degree bound to 4g-4 with two exceptional cases.


title: Revisiting Map Relations for Unsupervised Non-Rigid Shape Matching

abstract: We propose a novel unsupervised learning approach for non-rigid 3D shape matching. Our approach improves upon recent state-of-the art deep functional map methods and can be applied to a broad range of different challenging scenarios. Previous deep functional map methods mainly focus on feature extraction and aim exclusively at obtaining more expressive features for functional map computation. However, the importance of the functional map computation itself is often neglected and the relationship between the functional map and point-wise map is underexplored. In this paper, we systematically investigate the coupling relationship between the functional map from the functional map solver and the point-wise map based on feature similarity. To this end, we propose a self-adaptive functional map solver to adjust the functional map regularisation for different shape matching scenarios, together with a vertex-wise contrastive loss to obtain more discriminative features. Using different challenging datasets (including non-isometry, topological noise and partiality), we demonstrate that our method substantially outperforms previous state-of-the-art methods.


title: Characters of the unitriangular group and the Mackey method

abstract: Let $U$ be the unitriangular group over a finite field. We consider an interesting class of irreducible complex characters of $U$, so-called characters of depth 2. This is a next natural step after characters of maximal and submaximal dimension, whose description is already known. We explicitly describe the support of a character of depth 2 by a system of defining algebraic equations. After that, we calculate the value of such a character on an element from the support. The main technical tool used in the proofs is the Mackey little group method for semidirect products.


title: A Full Accounting of the Visible Mass in SDSS MaNGA Disk Galaxies

abstract: We present a study of the ratio of visible mass to total mass in spiral galaxies to better understand the relative amount of dark matter present in galaxies of different masses and evolutionary stages. Using the velocities of the H-alpha emission line measured in spectroscopic observations from the Sloan Digital Sky Survey (SDSS) MaNGA Data Release 17 (DR17), we evaluate the rotational velocity of over 5500 disk galaxies at their 90% elliptical Petrosian radii, R90. We compare this to the velocity expected from the total visible mass, which we compute from the stellar, HI, molecular hydrogen, and heavy metals and dust masses. Molecular hydrogen mass measurements are available for only a small subset of galaxies observed in SDSS MaNGA DR17, so we derive a parameterization of the molecular hydrogen mass as a function of absolute magnitude in the r band using galaxies observed as part of SDSS DR7. With these parameterizations, we calculate the fraction of visible mass within R90 that corresponds to the observed velocity. Based on statistically analyzing the likelihood of this fraction, we conclude that the null hypothesis (no dark matter) cannot be excluded at a confidence level better than 95% within the visible extent of the disk galaxies. We also find that when all mass components are included, the ratio of visible-to-total mass within the visible extent of star-forming disk galaxies increases with galaxy luminosity.


title: Predicting polymerization reactions via transfer learning using chemical language models

abstract: Polymers are candidate materials for a wide range of sustainability applications such as carbon capture and energy storage. However, computational polymer discovery lacks automated analysis of reaction pathways and stability assessment through retro-synthesis. Here, we report the first extension of transformer-based language models to polymerization reactions for both forward and retrosynthesis tasks. To that end, we have curated a polymerization dataset for vinyl polymers covering reactions and retrosynthesis for representative homo-polymers and co-polymers. Overall, we obtain a forward model Top-4 accuracy of 80% and a backward model Top-4 accuracy of 60%. We further analyze the model performance with representative polymerization and retro-synthesis examples and evaluate its prediction quality from a materials science perspective.


title: Theoretical investigation of delafossite-Cu2ZnSnO4 as a promising photovoltaic absorber

abstract: In the quest for efficient and cost-effective photovoltaic absorber materials beyond silicon, considerable attention has been directed toward exploring alternatives. One such material, zincblende-derived Cu2ZnSnS4 (CZTS), has shown promise due to its ideal band-gap size and high absorption coefficient. However, challenges such as structural defects and secondary phase formation have hindered its development. In this study, we examine the potential of another compound Cu2ZnSnO4 (CZTO) with a similar composition to CZTS as a promising alternative. Employing ab initio density function theory (DFT) calculations in combination with an evolutionary structure prediction algorithm, we identify that the crystalline phase of the delafossite structure is the most stable among the 900 (meta)stable CZTO. Its thermodynamic stability at room temperature is also confirmed by the molecular dynamics study. Excitingly, this new phase of CZTO displays a direct band gap where the dipole-allowed transition occurs, making it a strong candidate for efficient light absorption. Furthermore, the estimation of spectroscopic limited maximum efficiency (SLME) directly demonstrates the high potential of delafossite-CZTO as a photovoltaic absorber. Our numerical results suggest that delafossite-CZTO holds another promise for future photovoltaic applications.


title: Remarks on effects of projective phase on eigenstate thermalization hypothesis

abstract: The existence of $p$-form symmetry in $(d+1)$-dimensional quantum field is known to always lead to the breakdown of the eigenstate thermalization hypothesis (ETH) for certain $(d-p)$-dimensional operators other than symmetry operators under some assumptions. The assumptions include the mixing of symmetry sectors within a given energy shell, which is rather challenging to verify because it requires information on the eigenstates in the middle of the spectrum. We reconsider this assumption from the viewpoint of projective representations to avoid this difficulty. In the case of $\mathbb{Z}_N$ symmetries, we can circumvent the difficulty by considering $\mathbb{Z}_N\times\mathbb{Z}_N$-symmetric theories with nontrivial projective phases, and perturbing the Hamiltonian while preserving one of the $\mathbb{Z}_N$ symmetries of our interest. We also perform numerical analyses for $(1+1)$-dimensional spin chains and the $(2+1)$-dimensional $\mathbb{Z}_2$ lattice gauge theory.

categories: hep-th cond-mat.stat-mech cond-mat.str-el quant-ph


title: Underwater and Surface Aquatic Locomotion of Soft Biomimetic Robot Based on Bending Rolled Dielectric Elastomer Actuators

abstract: All-around, real-time navigation and sensing across the water environments by miniature soft robotics are promising, for their merits of small size, high agility and good compliance to the unstructured surroundings. In this paper, we propose and demonstrate a mantas-like soft aquatic robot which propels itself by flapping-fins using rolled dielectric elastomer actuators (DEAs) with bending motions. This robot exhibits fast-moving capabilities of swimming at 57mm/s or 1.25 body length per second (BL/s), skating on water surface at 64 mm/s (1.36 BL/s) and vertical ascending at 38mm/s (0.82 BL/s) at 1300 V, 17 Hz of the power supply. These results show the feasibility of adopting rolled DEAs for mesoscale aquatic robots with high motion performance in various water-related scenarios.


title: Induced Gravitational Waves from Non-attractor Inflation and NANOGrav data

abstract: In this paper, we investigate the scalar-induced gravitational waves in single-field non-attractor inflation for the Pulsar Timing Arrays data. Our model comprises three phases of inflation: the first and third phases are slow-roll inflation, while the second phase is a period of non-attractor inflation. We analyze the model's predictions for various values of the sound speed $c_s$ and examine the sharp transitions to the final attractor phase. Furthermore, we study the model's predictions for NANOGrav observations and future gravitational wave observations. We also calculate the non-Gaussianity parameter $f_{NL}$ for the non-attractor setup with a general sound speed and the sharpness parameter.


title: Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression

abstract: This work studies training instabilities of behavior cloning with deep neural networks. We observe that minibatch SGD updates to the policy network during training result in sharp oscillations in long-horizon rewards, despite negligibly affecting the behavior cloning loss. We empirically disentangle the statistical and computational causes of these oscillations, and find them to stem from the chaotic propagation of minibatch SGD noise through unstable closed-loop dynamics. While SGD noise is benign in the single-step action prediction objective, it results in catastrophic error accumulation over long horizons, an effect we term gradient variance amplification (GVA). We show that many standard mitigation techniques do not alleviate GVA, but find an exponential moving average (EMA) of iterates to be surprisingly effective at doing so. We illustrate the generality of this phenomenon by showing the existence of GVA and its amelioration by EMA in both continuous control and autoregressive language generation. Finally, we provide theoretical vignettes that highlight the benefits of EMA in alleviating GVA and shed light on the extent to which classical convex models can help in understanding the benefits of iterate averaging in deep learning.


title: Bulk Universality for Complex non-Hermitian Matrices with Independent and Identically Distributed Entries

abstract: We consider N x N matrices with complex entries that are perturbed by a complex Gaussian matrix with small variance. We prove that if the unperturbed matrix satisfies certain local laws then the bulk correlation functions are universal in the large N limit. Assuming the entries are independent and identically distributed with a common distribution that has finite moments, the Gaussian component is removed by the four moment theorem of Tao and Vu.


title: An Empirical Study of Translation Hypothesis Ensembling with Large Language Models

abstract: Large language models (LLMs) are becoming a one-fits-many solution, but they sometimes hallucinate or produce unreliable output. In this paper, we investigate how hypothesis ensembling can improve the quality of the generated text for the specific problem of LLM-based machine translation. We experiment with several techniques for ensembling hypotheses produced by LLMs such as ChatGPT, LLaMA, and Alpaca. We provide a comprehensive study along multiple dimensions, including the method to generate hypotheses (multiple prompts, temperature-based sampling, and beam search) and the strategy to produce the final translation (instruction-based, quality-based reranking, and minimum Bayes risk (MBR) decoding). Our results show that MBR decoding is a very effective method, that translation quality can be improved using a small number of samples, and that instruction tuning has a strong impact on the relation between the diversity of the hypotheses and the sampling temperature.


title: Identifying Interpretable Visual Features in Artificial and Biological Neural Systems

abstract: Single neurons in neural networks are often interpretable in that they represent individual, intuitively meaningful features. However, many neurons exhibit $\textit{mixed selectivity}$, i.e., they represent multiple unrelated features. A recent hypothesis proposes that features in deep networks may be represented in $\textit{superposition}$, i.e., on non-orthogonal axes by multiple neurons, since the number of possible interpretable features in natural data is generally larger than the number of neurons in a given network. Accordingly, we should be able to find meaningful directions in activation space that are not aligned with individual neurons. Here, we propose (1) an automated method for quantifying visual interpretability that is validated against a large database of human psychophysics judgments of neuron interpretability, and (2) an approach for finding meaningful directions in network activation space. We leverage these methods to discover directions in convolutional neural networks that are more intuitively meaningful than individual neurons, as we confirm and investigate in a series of analyses. Moreover, we apply the same method to three recent datasets of visual neural responses in the brain and find that our conclusions largely transfer to real neural data, suggesting that superposition might be deployed by the brain. This also provides a link with disentanglement and raises fundamental questions about robust, efficient and factorized representations in both artificial and biological neural systems.


title: On the Frozen F-theory Landscape

abstract: We study $6$d $\mathcal{N} = (1,0)$ supergravity theories arising in the frozen phase of F-theory. For each of the known global models, we construct an F-theory compactification in the unfrozen phase with an identical non-abelian gauge algebra and massless matter content. Two such low energy effective theories are then distinguished through gauge enhancements in moduli space. We study potentially new global models obtained via compact embeddings of a plethora of $6$d $\mathcal{N}= (1,0)$ superconformal field theories and little string theories constructed using frozen $7$-branes. In some cases, these provably do not exist, and in other cases, we explicitly construct a compact embedding, yielding $6$d supergravity theories with new massless spectra. Finally, by using gravitational anomaly cancellation, we conjecture the existence of localized neutral hypermultiplets along frozen $7$-brane loci.


title: Prebiotic Vitamin B$_3$ Synthesis in Carbonaceous Planetesimals

abstract: Aqueous chemistry within carbonaceous planetesimals is promising for synthesizing prebiotic organic matter essential to all life. Meteorites derived from these planetesimals delivered these life building blocks to the early Earth, potentially facilitating the origins of life. Here, we studied the formation of vitamin B$_3$ as it is an important precursor of the coenzyme NAD(P)(H), which is essential for the metabolism of all life as we know it. We propose a new reaction mechanism based on known experiments in the literature that explains the synthesis of vitamin B$_3$. It combines the sugar precursors glyceraldehyde or dihydroxyacetone with the amino acids aspartic acid or asparagine in aqueous solution without oxygen or other oxidizing agents. We performed thermochemical equilibrium calculations to test the thermodynamic favorability. The predicted vitamin B$_3$ abundances resulting from this new pathway were compared with measured values in asteroids and meteorites. We conclude that competition for reactants and decomposition by hydrolysis are necessary to explain the prebiotic content of meteorites. In sum, our model fits well into the complex network of chemical pathways active in this environment.


title: Is $K_{1}/K^{*}$ enhancement in heavy ion collisions a signature of chiral symmetry restoration?

abstract: We extend the recent study of $K_{1}/K^{*}$ enhancement as a signature of chiral symmetry restoration in heavy ion collisions at the Large Hadron Collider (LHC) via the kinetic approach to include the effects due to non-unity hadron fugacities during the evolution of produced hadronic matter and the temperature-dependent $K_1$ mass. Although the effect of non-unity fugacity only slightly reduces the $K_1/K^*$ enhancement due to chiral symmetry restoration, the inclusion of the temperature-dependent $K_1$ mass leads to a substantial reduction in the $K_1/K^*$ enhancement. However, the final $K_1/K^*$ ratio in peripheral collisions still shows a more than factor of two enhancement compared to the case without chiral symmetry restoration and thus remains a good signature for chiral symmetry restoration in the hot dense matter produced in relativistic heavy ion collisions.


title: Uncertainty Quantification For Turbulent Flows with Machine Learning

abstract: Turbulent flows are of central importance across applications in science and engineering problems. For design and analysis, scientists and engineers use Computational Fluid Dynamics (CFD) simulations using turbulence models. Turbulent models are limited approximations, introducing epistemic uncertainty in CFD results. For reliable design and analysis, we require quantification of these uncertainties. The Eigenspace Perturbation Method (EPM) is the preeminent physics based approach for turbulence model UQ, but often leads to overly conservative uncertainty bounds. In this study, we use Machine Learning (ML) models to moderate the EPM perturbations and introduce our physics constrained machine learning framework for turbulence model UQ. We test this framework in multiple problems to show that it leads to improved calibration of the uncertainty estimates.


title: Sadness, Anger, or Anxiety: Twitter Users' Emotional Responses to Toxicity in Public Conversations

abstract: Cyberbullying and online harassment have serious negative psychological and emotional consequences for the victims, such as decreased life satisfaction, suicidal ideation, self-harming behaviors, depression, anxiety, and others. Most of the prior works assessed people's emotional responses via questionnaires, while social media platforms contain data that could provide valuable insights into users' emotions in real online discussions. Therefore, this data-driven study investigates the effect of toxicity on Twitter users' emotions and other factors associated with expressing anger, anxiety, and sadness in terms of account identifiability, activity, conversation structure, and conversation topic. To achieve this goal, we identified toxic replies in the large dataset consisting of 79,799 random Twitter conversations and obtained the emotions expressed in these conversations. Then, we performed propensity score matching and analyzed causal associations between toxicity and users' emotions. In general, we found that users receiving toxic replies are more likely to express emotions of anger, sadness, and anxiety compared to users who did not receive toxic replies. Finally, analysis results indicate that the conversation topic and users' account characteristics are likely to affect their emotional responses to toxicity. Our findings provide a better understanding of toxic replies' consequences on users' emotional states, which can potentially lead to developing personalized moderation methods that will help users emotionally cope with toxicity on social media.


title: On Faces and Hilbert Bases of Kostka Cones

abstract: Kostka coefficients appear in the representation theory of the general linear group and enumerate semistandard Young tableaux of fixed shape and content. The $r$-Kostka cone is the real polyhedral cone generated by pairs of partitions with at most $r$ parts, written as non-increasing $r$-tuples, such that the corresponding Kostka coefficient is nonzero. We provide several results showing that its faces have interesting structural and enumerative properties. We show that the $d$-faces of the $r$-Kostka cone can be determined from those of the $(3d+3)$-Kostka cone, allowing us to characterize its $2$-faces and enumerate its $d$-faces for $d \leq 4$. We provide tight asymptotics for the number of $d$-faces for arbitrary $d$ and determine the maximum number of extremal rays contained in a $d$-face for $d < r$. We then make progress towards a generalization of the Gao-Kiers-Orelowitz-Yong Width Bound on initial entries of partitions $(\lambda,\mu)$ appearing in the Hilbert basis of the $\lambda_1$-Kostka cone. We show that at least $93.7\%$ of integer pairs $\lambda_1 \geq \mu_1 > 0$ appear as the initial entries of partitions $(\lambda,\mu)$ comprising a Hilbert basis element of the $r$-Kostka cone for every $r > \lambda_1$. We conclude with a conjecture about a curious $h$-vector phenomenon.


title: An empirical connection between line-emitting regions and X-rays heating the accretion disc in BH-LMXB MAXI J1820$+$070

abstract: The recurring transient outbursts in low-mass X-ray binaries (LMXBs) provide ideal laboratories to study the accretion process. Unlike their supermassive relatives, LMXBs are far too small and distant to be imaged directly. Fortunately, phase-resolved spectroscopy can provide an alternative diagnostic to study their highly complex, time-dependent accretion discs. The primary spectral signature of LMXBs are strong, disc-formed emission lines detected at optical wavelengths. The shape, profile, and appearance/disappearance of these lines change throughout a binary orbit, and thus, can be used to trace how matter in these discs behaves and evolves over time. By combining a \textit{Swift} multi-wavelength monitoring campaign, phase-resolved spectroscopy from the Gran Telescopio Canarias (GTC) and Liverpool Telescope, and modern astrotomography techniques, we find a clear empirical connection between the line emitting regions and physical properties of the X-rays heating the disc in the black hole LMXB MAXI J1820+070 during its 2018 outburst. In this paper, we show how these empirical correlations can be used as an effective observational tool for understanding the geometry and structure of a LMXB accretion disc and present further evidence for an irradiation-driven warped accretion disc present in this system.


title: From Alexnet to Transformers: Measuring the Non-linearity of Deep Neural Networks with Affine Optimal Transport

abstract: In the last decade, we have witnessed the introduction of several novel deep neural network (DNN) architectures exhibiting ever-increasing performance across diverse tasks. Explaining the upward trend of their performance, however, remains difficult as different DNN architectures of comparable depth and width -- common factors associated with their expressive power -- may exhibit a drastically different performance even when trained on the same dataset. In this paper, we introduce the concept of the non-linearity signature of DNN, the first theoretically sound solution for approximately measuring the non-linearity of deep neural networks. Built upon a score derived from closed-form optimal transport mappings, this signature provides a better understanding of the inner workings of a wide range of DNN architectures and learning paradigms, with a particular emphasis on the computer vision task. We provide extensive experimental results that highlight the practical usefulness of the proposed non-linearity signature and its potential for long-reaching implications. The code for our work is available at https://github.com/qbouniot/AffScoreDeep


title: EvalCrafter: Benchmarking and Evaluating Large Video Generation Models

abstract: The vision and language generative models have been overgrown in recent years. For video generation, various open-sourced models and public-available services have been developed to generate high-quality videos. However, these methods often use a few metrics, e.g., FVD or IS, to evaluate the performance. We argue that it is hard to judge the large conditional generative models from the simple metrics since these models are often trained on very large datasets with multi-aspect abilities. Thus, we propose a novel framework and pipeline for exhaustively evaluating the performance of the generated videos. Our approach involves generating a diverse and comprehensive list of 700 prompts for text-to-video generation, which is based on an analysis of real-world user data and generated with the assistance of a large language model. Then, we evaluate the state-of-the-art video generative models on our carefully designed benchmark, in terms of visual qualities, content qualities, motion qualities, and text-video alignment with 17 well-selected objective metrics. To obtain the final leaderboard of the models, we further fit a series of coefficients to align the objective metrics to the users' opinions. Based on the proposed human alignment method, our final score shows a higher correlation than simply averaging the metrics, showing the effectiveness of the proposed evaluation method.


title: Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4V

abstract: We present Set-of-Mark (SoM), a new visual prompting method, to unleash the visual grounding abilities of large multimodal models (LMMs), such as GPT-4V. As illustrated in Fig. 1 (right), we employ off-the-shelf interactive segmentation models, such as SEEM/SAM, to partition an image into regions at different levels of granularity, and overlay these regions with a set of marks e.g., alphanumerics, masks, boxes. Using the marked image as input, GPT-4V can answer the questions that require visual grounding. We perform a comprehensive empirical study to validate the effectiveness of SoM on a wide range of fine-grained vision and multimodal tasks. For example, our experiments show that GPT-4V with SoM in zero-shot setting outperforms the state-of-the-art fully-finetuned referring expression comprehension and segmentation model on RefCOCOg. Code for SoM prompting is made public at: https://github.com/microsoft/SoM.


title: Trusted Provenance of Automated, Collaborative and Adaptive Data Processing Pipelines

abstract: To benefit from the abundance of data and the insights it brings data processing pipelines are being used in many areas of research and development in both industry and academia. One approach to automating data processing pipelines is the workflow technology, as it also supports collaborative, trial-and-error experimentation with the pipeline architecture in different application domains. In addition to the necessary flexibility that such pipelines need to possess, in collaborative settings cross-organisational interactions are plagued by lack of trust. While capturing provenance information related to the pipeline execution and the processed data is a first step towards enabling trusted collaborations, the current solutions do not allow for provenance of the change in the processing pipelines, where the subject of change can be made on any aspect of the workflow implementing the pipeline and on the data used while the pipeline is being executed. Therefore in this work we provide a solution architecture and a proof of concept implementation of a service, called Provenance Holder, which enable provenance of collaborative, adaptive data processing pipelines in a trusted manner. We also contribute a definition of a set of properties of such a service and identify future research directions.


title: Operations on the set of scalar and matrix-valued quiddity sequences

abstract: Our purpose with this paper is, in first place, to recast the space of quiddity sequences corresponding to usual frieze patterns as a different type of SET operad, and second to introduce and study $\mathfrak{M}$-quiddity sequences where $\mathfrak{M}$ is a monodromy block matrix of order two. Also, we examine some related topic as are the possibility of to define matrix-valued friezes patterns and noncommutative signed Chebyshev polynomials.


title: Parabolic First-Order Mean Field Games with Neumann Boundary Conditions

abstract: The primary objective of this paper is to understand first-order, time-dependent mean-field games with Neumann boundary conditions, a question that remains under-explored in the literature. This matter is particularly relevant given the importance of boundary conditions in crowd models. In our model, the Neumann conditions result from players entering the domain according to a prescribed current, for instance, in a crowd entry scenario into an open-air concert or stadium. We formulate the model as a standard mean-field game coupling a Hamilton-Jacobi equation with a Fokker-Planck equation. Then, we introduce a relaxed variational problem and use Fenchel-Rockafellar duality to study the relation between these problems. Finally, we prove the existence and uniqueness of solutions for the system using variational methods.


title: Stochastic Quantum Sampling for Non-Logconcave Distributions and Estimating Partition Functions

abstract: We present quantum algorithms for sampling from non-logconcave probability distributions in the form of $\pi(x) \propto \exp(-\beta f(x))$. Here, $f$ can be written as a finite sum $f(x):= \frac{1}{N}\sum_{k=1}^N f_k(x)$. Our approach is based on quantum simulated annealing on slowly varying Markov chains derived from unadjusted Langevin algorithms, removing the necessity for function evaluations which can be computationally expensive for large data sets in mixture modeling and multi-stable systems. We also incorporate a stochastic gradient oracle that implements the quantum walk operators inexactly by only using mini-batch gradients. As a result, our stochastic gradient based algorithm only accesses small subsets of data points in implementing the quantum walk. One challenge of quantizing the resulting Markov chains is that they do not satisfy the detailed balance condition in general. Consequently, the mixing time of the algorithm cannot be expressed in terms of the spectral gap of the transition density, making the quantum algorithms nontrivial to analyze. To overcome these challenges, we first build a hypothetical Markov chain that is reversible, and also converges to the target distribution. Then, we quantified the distance between our algorithm's output and the target distribution by using this hypothetical chain as a bridge to establish the total complexity. Our quantum algorithms exhibit polynomial speedups in terms of both dimension and precision dependencies when compared to the best-known classical algorithms.


title: Functional Invariants to Watermark Large Transformers

abstract: The rapid growth of transformer-based models increases the concerns about their integrity and ownership insurance. Watermarking addresses this issue by embedding a unique identifier into the model, while preserving its performance. However, most existing approaches require to optimize the weights to imprint the watermark signal, which is not suitable at scale due to the computational cost. This paper explores watermarks with virtually no computational cost, applicable to a non-blind white-box setting (assuming access to both the original and watermarked networks). They generate functionally equivalent copies by leveraging the models' invariance, via operations like dimension permutations or scaling/unscaling. This enables to watermark models without any change in their outputs and remains stealthy. Experiments demonstrate the effectiveness of the approach and its robustness against various model transformations (fine-tuning, quantization, pruning), making it a practical solution to protect the integrity of large models.


title: Nondango is NP-Complete

abstract: Nondango is a pencil puzzle consisting of a rectangular grid partitioned into regions, with some cells containing a white circle. The player has to color some circles black such that every region contains exactly one black circle, and there are no three consecutive circles (horizontally, vertically, or diagonally) having the same color. In this paper, we prove that deciding solvability of a given Nondango puzzle is NP-complete.


title: 4K4D: Real-Time 4D View Synthesis at 4K Resolution

abstract: This paper targets high-fidelity and real-time view synthesis of dynamic 3D scenes at 4K resolution. Recently, some methods on dynamic view synthesis have shown impressive rendering quality. However, their speed is still limited when rendering high-resolution images. To overcome this problem, we propose 4K4D, a 4D point cloud representation that supports hardware rasterization and enables unprecedented rendering speed. Our representation is built on a 4D feature grid so that the points are naturally regularized and can be robustly optimized. In addition, we design a novel hybrid appearance model that significantly boosts the rendering quality while preserving efficiency. Moreover, we develop a differentiable depth peeling algorithm to effectively learn the proposed model from RGB videos. Experiments show that our representation can be rendered at over 400 FPS on the DNA-Rendering dataset at 1080p resolution and 80 FPS on the ENeRF-Outdoor dataset at 4K resolution using an RTX 4090 GPU, which is 30x faster than previous methods and achieves the state-of-the-art rendering quality. Our project page is available at https://zju3dv.github.io/4k4d/.


title: DELIFFAS: Deformable Light Fields for Fast Avatar Synthesis

abstract: Generating controllable and photorealistic digital human avatars is a long-standing and important problem in Vision and Graphics. Recent methods have shown great progress in terms of either photorealism or inference speed while the combination of the two desired properties still remains unsolved. To this end, we propose a novel method, called DELIFFAS, which parameterizes the appearance of the human as a surface light field that is attached to a controllable and deforming human mesh model. At the core, we represent the light field around the human with a deformable two-surface parameterization, which enables fast and accurate inference of the human appearance. This allows perceptual supervision on the full image compared to previous approaches that could only supervise individual pixels or small patches due to their slow runtime. Our carefully designed human representation and supervision strategy leads to state-of-the-art synthesis results and inference time. The video results and code are available at https://vcai.mpi-inf.mpg.de/projects/DELIFFAS.


title: Explaining Deep Neural Networks for Bearing Fault Detection with Vibration Concepts

abstract: Concept-based explanation methods, such as Concept Activation Vectors, are potent means to quantify how abstract or high-level characteristics of input data influence the predictions of complex deep neural networks. However, applying them to industrial prediction problems is challenging as it is not immediately clear how to define and access appropriate concepts for individual use cases and specific data types. In this work, we investigate how to leverage established concept-based explanation techniques in the context of bearing fault detection with deep neural networks trained on vibration signals. Since bearings are prevalent in almost every rotating equipment, ensuring the reliability of intransparent fault detection models is crucial to prevent costly repairs and downtimes of industrial machinery. Our evaluations demonstrate that explaining opaque models in terms of vibration concepts enables human-comprehensible and intuitive insights about their inner workings, but the underlying assumptions need to be carefully validated first.


title: Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective

abstract: Large Language Models (LLMs) inherently encode a wealth of knowledge within their parameters through pre-training on extensive corpora. While prior research has delved into operations on these parameters to manipulate the underlying implicit knowledge (encompassing detection, editing, and merging), there remains an ambiguous understanding regarding their transferability across models with varying scales. In this paper, we seek to empirically investigate knowledge transfer from larger to smaller models through a parametric perspective. To achieve this, we employ sensitivity-based techniques to extract and align knowledge-specific parameters between different LLMs. Moreover, the LoRA module is used as the intermediary mechanism for injecting the extracted knowledge into smaller models. Evaluations across four benchmarks validate the efficacy of our proposed method. Our findings highlight the critical factors contributing to the process of parametric knowledge transfer, underscoring the transferability of model parameters across LLMs of different scales. Project website: https://maszhongming.github.io/ParaKnowTransfer.


title: Hamiltonicity and related properties in $K_{r+1}$-free graphs

abstract: We prove best-possible edge density conditions sufficient to guarantee traceability, Hamiltonicity, chorded pancyclicity, Hamiltonian-connectedness, $k$-path Hamiltonicity, and $k$-Hamiltonicity in $K_{r+1}$-free graphs. We characterize the extremal graphs. Then we extend these edge density conditions to clique density conditions. Equivalently, we introduce variants of the extremal number $\mathrm{ex}(n,F)$ and the generalized extremal number $\mathrm{ex}(n,H,F)$ -- that is, the maximum numbers of edges and copies of $H$, respectively, in $n$-vertex, $F$-free graphs -- in which we require that these graphs not be traceable, Hamiltonian, chorded pancyclic, Hamiltonian-connected, $k$-path Hamiltonian, or $k$-Hamiltonian, and we determine their values for $F=K_{r+1}$ and $H=K_t$.


title: BitNet: Scaling 1-bit Transformers for Large Language Models

abstract: The increasing size of large language models has posed challenges for deployment and raised concerns about environmental impact due to high energy consumption. In this work, we introduce BitNet, a scalable and stable 1-bit Transformer architecture designed for large language models. Specifically, we introduce BitLinear as a drop-in replacement of the nn.Linear layer in order to train 1-bit weights from scratch. Experimental results on language modeling show that BitNet achieves competitive performance while substantially reducing memory footprint and energy consumption, compared to state-of-the-art 8-bit quantization methods and FP16 Transformer baselines. Furthermore, BitNet exhibits a scaling law akin to full-precision Transformers, suggesting its potential for effective scaling to even larger language models while maintaining efficiency and performance benefits.


title: VeRA: Vector-based Random Matrix Adaptation

abstract: Low-rank adapation (LoRA) is a popular method that reduces the number of trainable parameters when finetuning large language models, but still faces acute storage challenges when scaling to even larger models or deploying numerous per-user or per-task adapted models. In this work, we present Vector-based Random Matrix Adaptation (VeRA), which significantly reduces the number of trainable parameters compared to LoRA, yet maintains the same performance. It achieves this by using a single pair of low-rank matrices shared across all layers and learning small scaling vectors instead. We demonstrate its effectiveness on the GLUE and E2E benchmarks, image classification tasks, and show its application in instruction-tuning of 7B and 13B language models.


title: Cutting $\gamma$-Liouville quantum gravity by Schramm-Loewner evolution for $\kappa \not\in \{\gamma^2, 16/\gamma^2\}$

abstract: There are many deep and useful theorems relating Schramm-Loewner evolution (SLE$_\kappa$) and Liouville quantum gravity ($\gamma$-LQG) in the case when the parameters satisfy $\kappa \in \{\gamma^2, 16/\gamma^2\}$. Roughly speaking, these theorems say that the SLE$_\kappa$ curve cuts the $\gamma$-LQG surface into two or more independent $\gamma$-LQG surfaces. We extend these theorems to the case when $\kappa \not\in \{\gamma^2, 16/\gamma^2\}$. Roughly speaking we show that if we have an appropriate variant of SLE$_\kappa$ and an independent $\gamma$-LQG disk, then the SLE curve cuts the LQG disk into two or more $\gamma$-LQG surfaces which are conditionally independent given the values along the SLE curve of a certain collection of auxiliary imaginary geometry fields, viewed modulo conformal coordinate change. These fields are sampled independently from the SLE and the LQG and have the property that that the sum of the central charges associated with the SLE$_\kappa$ curve, the $\gamma$-LQG surface, and the auxiliary fields is 26. This condition on the central charge is natural from the perspective of bosonic string theory. We also prove analogous statements when the SLE curve is replaced by, e.g., an LQG metric ball or a Brownian motion path. Statements of this type were conjectured by Sheffield and are continuum analogs of certain Markov properties of random planar maps decorated by two or more statistical physics models. We include a substantial list of open problems.


title: Innovative NiAl Electrodes for Long-Term, Intermediate High-Temperature SAW Sensing Applications Using LiNbO$_3$ Substrates

abstract: Wireless SAW reflective delay line (R-DL) technology is very powerful to carry out remote measurements of various parameters under harsh environments, while enabling the identification of a given sensor among several of them. However, R-DL technology is currently limited to 350$^\circ$C for long-term applications, likely because of aluminium electrodes oxidation and/or congruent lithium niobate segregation process. In this study, an innovative alloy, namely NiAl, is investigated as an alternative to Al to make R-DLs able to withstand high temperatures up to 500$^\circ$C on the long term. Indeed, NiAl gathers, in the bulk state, all the necessary properties (fairly low electrical resistivity and density, high melting temperature and resistance to oxidation). The study also examines the extent of the congruent LiNbO$_3$ segregation process, to determine its impact on the NiAl/LiNbO$_3$ R-DLs performances. The obtained results are very promising. NiAl electrodes self-passivate during the first 50h of annealing at 500$^\circ$C: 20 nm-thick Al$_2$O$_3$ layers form at the surface and in between the electrodes and the substrate, protecting the remaining NiAl layer from further oxidation. Besides, the segregation process occurs mainly in the same time. It is located in the first 150-200 nm of the substrate. Both phenomena have no significant impact on the performance of NiAl/LiNbO$_3$ R-DLs working at 433 MHz. Continuous in-situ electrical monitoring of such devices shows a standard deviation of the operating frequency of only 1.04 ppm during an annealing process of 250h at 500$^\circ$C. Moreover, the time-resolved S11 response of the device at the end of this treatment is not degraded at all. Thus, 433 MHz NiAl/LiNbO$_3$ R-DL sensors can operate with high fidelity for at least 10 days at 500$^\circ$C under air atmosphere, and there are strong signs that their lifetime is actually much longer.


title: The greatest GOES soft X-ray flares: Saturation and recalibration over two Hale cycles

abstract: The solar soft X-ray observations from the GOES satellites provide one of the best quantitative records of solar activity, with nearly continuous flare records since 1975. We present a uniform analysis of the entire time series for 1975 to 2022 at NOAA class C1 level or above, to characterize the occurrence distribution function (ODF) of the flares observed in the 1-8 A spectral band. The analysis includes estimations of the peak fluxes of the 12 flares that saturated the 1-8 A time series. Our new estimates include NOAA's recently established correction factor (1.43) to adjust the GOES-1 through GOES-15 data covering 1975-2016. For each of the 12 saturated events we have made new estimates of peak fluxes based on fits to the rise and fall of the flare time profile, and have validated our extrapolation schemes by comparing with artificially truncated but unsaturated X10-class events. SOL2003-11-04 now has a peak flux of 4.32e-3 W/m^2. This corresponds to X43 on the new scale, or X30 on the old scale. We provide a list in the Appendix for peak fluxes of all 38 events above 10^-3 W/m^2, the GOES X10 level, including the 12 saturated events. The full list now gives us a first complete sample from which we obtain an occurrence distribution function (ODF) for peak energy flux , often represented as a power law dF/dE ~ E^-alpha, for which we find alpha = 1.973 +- 0.014 in the range M1 to X3. The power-law description fails at the high end, requiring a downward break in the ODF above the X10 level. We give a tapered powerlaw description of the resulting CCDF (complementary cumulative distribution function) and extrapolate it into the domain of "superflares," i.e. flares with bolometric energies > 10^33 erg. Extrapolation of this fit provides estimates of 100-yr and 1000-yr GOES peak fluxes that agree reasonably well with other such estimates using different data sets and methodology.


title: GPT-4 as an interface between researchers and computational software: improving usability and reproducibility

abstract: Large language models (LLMs) are playing an increasingly important role in science and engineering. For example, their ability to parse and understand human and computer languages makes them powerful interpreters and their use in applications like code generation are well-documented. We explore the ability of the GPT-4 LLM to ameliorate two major challenges in computational materials science: i) the high barriers for adoption of scientific software associated with the use of custom input languages, and ii) the poor reproducibility of published results due to insufficient details in the description of simulation methods. We focus on a widely used software for molecular dynamics simulations, the Large-scale Atomic/Molecular Massively Parallel Simulator (LAMMPS), and quantify the usefulness of input files generated by GPT-4 from task descriptions in English and its ability to generate detailed descriptions of computational tasks from input files. We find that GPT-4 can generate correct and ready-to-use input files for relatively simple tasks and useful starting points for more complex, multi-step simulations. In addition, GPT-4's description of computational tasks from input files can be tuned from a detailed set of step-by-step instructions to a summary description appropriate for publications. Our results show that GPT-4 can reduce the number of routine tasks performed by researchers, accelerate the training of new users, and enhance reproducibility.


title: Ratings of European and South American Football Leagues Based on Glicko-2 with Modifications

abstract: One of the key problems in the field of soccer analytics is predicting how a player performance changes when transitioning from one league to another. One potential solution to address this issue lies in the evaluation of the respective league strength. This article endeavors to compute club ratings of the first and second European and South American leagues. In order to calculate these ratings, the authors have designed the Glicko-2 rating system-based approach, which overcomes some Glicko-2 limitations. Particularly, the authors took into consideration the probability of the draw, the home-field advantage, and the property of teams to become stronger or weaker following their league transitions. Furthermore, authors have constructed a predictive model for forecasting match results based on the number of goals scored in previous matches. The metrics utilized in the analysis reveal that the Glicko-2 based approach exhibits a marginally superior level of accuracy when compared to the commonly used Poisson regression-based approach. In addition, Glicko-2 based ratings offer greater interpretability and can find application in various analytics tasks, such as predicting soccer player metrics for forthcoming seasons or the detailed analysis of a player performance in preceding matches. The implementation of the approach is available on github.com/andreyshelopugin/GlickoSoccer.


title: Skateboarding stance and handedness: A brief analysis of relationship, proportions and influences

abstract: The aim of this paper is to show the relationship that lies in the fact of a person being right or left handed, in their skateboarding stance. Starting from the null hypothesis that there is no relationship, the Pearson's X^2 with Yates correction tests, as well as its respective p-value will be used to test the hypothesis. It will also be calculated and analyzed the residuals, Cramer's V and the Risk and Odds Ratios, with their respective confidence intervals to know the intensity of the association.


title: Interaction of Electromagnetic Radiation with Luminal Mirror

abstract: A modulation of refractive index can move at the speed of light. How it interacts with an electromagnetic wave? Does it reflect? We show that an incident electromagnetic wave, depending on its frequency either is totally transmitted with a phase shift, or forms a standing wave, or is totally reflected with the frequency upshift. A short incident pulse is converted into a wavepacket that has all three parts (transmitted, standing and reflected waves). The reflected part near the interface exhibits an infinitely growing in time local frequency. The wavepacket's energy spectral density asymptotically is the inverse square of frequency. If the refractive index modulation disappears, the high frequency radiation is released.


title: Multi-photon time-of-flight MLEM application for the positronium imaging in J-PET

abstract: We develop a positronium imaging method for the Jagiellonian PET (J-PET) scanners based on the time-of-flight maximum likelihood expectation maximisation (TOF MLEM). The system matrix elements are calculated on-the-fly for the coincidences comprising two annihilation and one de-excitation photons that originate from the ortho-positronium (o-Ps) decay. Using the Geant4 library, a Monte Carlo simulation was conducted for four cylindrical 22Na sources of beta plus decay with diverse o-Ps mean lifetimes, placed symmetrically inside the two JPET prototypes. The estimated time differences between the annihilation and the positron emission were aggregated into histograms (one per voxel), updated by the weights of the activities reconstructed by TOF MLEM. The simulations were restricted to include only the o-Ps decays into back-to-back photons, allowing a linear fitting model to be employed for the estimation of the mean lifetime from each histogram built in the log scale. To suppress the noise, the exclusion of voxels with activity below 2-10 percent of the peak was studied. The estimated o-Ps mean lifetimes were consistent with the simulation and distributed quasi-uniformly at high MLEM iterations. The proposed positronium imaging technique can be further upgraded to include various correction factors, as well as be modified according to realistic o-Ps decay models.


title: A new inelastic neutron spectrometer HODACA

abstract: A new multiplex-type inelastic neutron scattering spectrometer, HOrizontally Defocusing Analyzer Concurrent data Acquisition spectrometer (HODACA), was recently developed and built at the C1-1 cold neutron beam port in JRR-3. The spectrometer is suitable for dynamics measurements in the energy range of $-1$ meV $\lesssim \hbar \omega \lesssim$ 7 meV, catering to a broad array of research fields in physics and material science. HODACA combines 24 detectors and 132 pieces of analyzer crystals and has an estimated measurement efficiency that is 70 times greater than the existing conventional triple-axis spectrometer at the C1-1 beam port. The concept, design, specification, and results of commissioning experiments are described.

categories: physics.ins-det cond-mat.mtrl-sci cond-mat.str-el cond-mat.supr-con


title: Alzheimer Disease is Associated with Isotropic Ocular Enlargement

abstract: Recent studies have documented ocular changes in dementia patients, especially Alzheimer Disease (AD). In this study, we explored the change of eye size and eye shape in dementia, including AD patients. The eyeball volume and diameters were estimated via T1-weighted brain magnetic resonance (MR) images in the OASIS-3 database which included 83 AD, 247 non-AD dementiaand 336 normal-aging participants qualified for this study. After adjustment of age, sex, race, apolipoprotein E genotypes, anisotropic ratio and intracranial volume, we observed the eyeball volume of the AD group was significantly larger than both the normal control (6871mm3 vs 6415mm3, p < 0.001) and the non-AD dementia group (6871mm3 vs 6391 mm3, p < 0.001), but there was no difference between the non-AD dementia group and the normal control (6391 mm3 vs 6415mm3, p = 0.795). Similar results were observed for the axial, transverse and vertical length. No group differences were observed in the anisotropic ratio, indicating an isotropic volume increaseconsistent with previous changes induced by the ocular hypertension (OH), which suggested possible elevation of the intraocular pressure (IOP) in AD. In consideration of the recent findings in ocular changes of dementia, our findings emphasize routine eye examinations and eye cares for AD patients in the clinic.


title: BaitBuster-Bangla: A Comprehensive Dataset for Clickbait Detection in Bangla with Multi-Feature and Multi-Modal Analysis

abstract: This study presents a large multi-modal Bangla YouTube clickbait dataset consisting of 253,070 data points collected through an automated process using the YouTube API and Python web automation frameworks. The dataset contains 18 diverse features categorized into metadata, primary content, engagement statistics, and labels for individual videos from 58 Bangla YouTube channels. A rigorous preprocessing step has been applied to denoise, deduplicate, and remove bias from the features, ensuring unbiased and reliable analysis. As the largest and most robust clickbait corpus in Bangla to date, this dataset provides significant value for natural language processing and data science researchers seeking to advance modeling of clickbait phenomena in low-resource languages. Its multi-modal nature allows for comprehensive analyses of clickbait across content, user interactions, and linguistic dimensions to develop more sophisticated detection methods with cross-linguistic applications.


title: Protein 3D Graph Structure Learning for Robust Structure-based Protein Property Prediction

abstract: Protein structure-based property prediction has emerged as a promising approach for various biological tasks, such as protein function prediction and sub-cellular location estimation. The existing methods highly rely on experimental protein structure data and fail in scenarios where these data are unavailable. Predicted protein structures from AI tools (e.g., AlphaFold2) were utilized as alternatives. However, we observed that current practices, which simply employ accurately predicted structures during inference, suffer from notable degradation in prediction accuracy. While similar phenomena have been extensively studied in general fields (e.g., Computer Vision) as model robustness, their impact on protein property prediction remains unexplored. In this paper, we first investigate the reason behind the performance decrease when utilizing predicted structures, attributing it to the structure embedding bias from the perspective of structure representation learning. To study this problem, we identify a Protein 3D Graph Structure Learning Problem for Robust Protein Property Prediction (PGSL-RP3), collect benchmark datasets, and present a protein Structure embedding Alignment Optimization framework (SAO) to mitigate the problem of structure embedding bias between the predicted and experimental protein structures. Extensive experiments have shown that our framework is model-agnostic and effective in improving the property prediction of both predicted structures and experimental structures. The benchmark datasets and codes will be released to benefit the community.


title: Enhancing Binary Code Comment Quality Classification: Integrating Generative AI for Improved Accuracy

abstract: This report focuses on enhancing a binary code comment quality classification model by integrating generated code and comment pairs, to improve model accuracy. The dataset comprises 9048 pairs of code and comments written in the C programming language, each annotated as "Useful" or "Not Useful." Additionally, code and comment pairs are generated using a Large Language Model Architecture, and these generated pairs are labeled to indicate their utility. The outcome of this effort consists of two classification models: one utilizing the original dataset and another incorporating the augmented dataset with the newly generated code comment pairs and labels.


title: Explicit estimates for the sum $\sum_{k=0}^{n} k! {n\choose k}^2 (-1)^{k}$

abstract: We are interested in finding an explicit estimate to the binomial sum $Q_n(t)=\sum_{k=0}^{n} k! {n\choose k}^2 (-t)^{k}$ at $t=1$ for $n=0,1,2,\ldots$. Despite of its own interest the polynomial $Q_n(t)$ is important as the denominator in the Pad\'e identity of the Euler's factorial series $E(t) = \sum_{k=0}^{\infty} k! t^k$ as well as its close connection to a classical Laguerre polynomial $L_n(t) = \frac{1}{n!} e^t \left(\frac{d}{dt}\right)^n (e^{-t}t^n)$. Our main result is the explicit bound $\left|L_n(1)-\sqrt{\frac{e}{\pi}}\cdot \frac{\cos\left(2\sqrt{n}-\frac{\pi}{4}\right)}{n^{1/4}}\right|<\frac{2.38}{n^{3/4}}$ for all $n=0,1,2,\ldots$, which replaces the F\'ejer's asymptotic formula from 1909. As a corollary of this, one also gets a new proof for the bound $|Q_{n}(1)| \le n!$, and even more.


title: Blinding for precision scattering experiments: The MUSE approach as a case study

abstract: Human bias is capable of changing the analysis of measured data sufficiently to alter the results of an experiment. It is incumbent upon modern experiments, especially those investigating quantities considered contentious in the broader community, to blind their analysis in an effort to minimize bias. The choice of a blinding model is experiment specific, but should also aim to prevent accidental release of results before an analysis is finalized. In this paper, we discuss common threats to an unbiased analysis, as well as common quantities that can be blinded in different types of nuclear physics experiments. We use the Muon Scattering Experiment as an example, and detail the blinding scheme used therein.


title: Classic machine learning methods

abstract: In this chapter, we present the main classic machine learning methods. A large part of the chapter is devoted to supervised learning techniques for classification and regression, including nearest-neighbor methods, linear and logistic regressions, support vector machines and tree-based algorithms. We also describe the problem of overfitting as well as strategies to overcome it. We finally provide a brief overview of unsupervised learning methods, namely for clustering and dimensionality reduction.


title: Modeling lower-truncated and right-censored insurance claims with an extension of the MBBEFD class

abstract: In general insurance, claims are often lower-truncated and right-censored because insurance contracts may involve deductibles and maximal covers. Most classical statistical models are not (directly) suited to model lower-truncated and right-censored claims. A surprisingly flexible family of distributions that can cope with lower-truncated and right-censored claims is the class of MBBEFD distributions that originally has been introduced by Bernegger (1997) for reinsurance pricing, but which has not gained much attention outside the reinsurance literature. Interestingly, in general insurance, we mainly rely on unimodal skewed densities, whereas the reinsurance literature typically proposes monotonically decreasing densities within the MBBEFD class. We show that this class contains both types of densities, and we extend it to a bigger family of distribution functions suitable for modeling lower-truncated and right-censored claims. In addition, we discuss how changes in the deductible or the maximal cover affect the chosen distributions.


title: The Sponge Cake Dilemma over the Nile: Achieving Fairness in Resource Allocation with Cake Cutting Algorithms

abstract: This article explores the intricate dynamics of the Nile Basin dispute, a complex conflict involving Egypt, Ethiopia, and Sudan. Our central argument is that we can gain unique insights into this dispute by employing the principles of game theory and the Steinhaus cake-cutting problem - a mathematical model of fair division. These theoretical frameworks offer a novel perspective to understand the motivations and potential actions of the involved nations. More importantly, these concepts can illuminate potential pathways toward a resolution that ensures equitable resource allocation and maintains regional stability. We will analyze the conflict and explore potential solutions to this enduring dispute through this lens.


title: Digital LLRF system for TRIUMF ISIS buncher

abstract: The ISIS buncher system at TRIUMF operates at frequencies of 23MHz, 46MHz, and 4.6MHz. The 23MHz and 46MHz signals drive two buncher cavities, while the 4.6MHz signal drives the 5:1 selector. The previous analog-digital hybrid system has been replaced with a new digital LLRF system due to occasional drifts in the setpoints of the control loops during operation. The reference signal for the LLRF system is obtained from the pickup signal of the cyclotron's cavity, ensuring that all frequencies are synchronized with it. In the event of a spark occurring in the cyclotron's cavity, the LLRF system may lose its reference signal. To address this, a phase-locked loop with a track and hold function is designed to maintain the frequency when the reference signal is absent. The 4.6MHz frequency is derived by dividing the 23MHz reference signal frequency by 5. Designing the divide-by-5 circuitry posed specific challenges in a binary system. The LLRF system is built upon TRIUMF's versatile digital LLRF hardware system, with firmware optimized specifically for the ISIS buncher system. This paper will delve into the details of the hardware and firmware.


title: Viscosity solutions to HJB equations associated with optimal control problem for McKean-Vlasov SDEs

abstract: This work concerns the optimal control problem for McKean-Vlasov SDEs. In order to characterize the value function, we develop the viscosity solution theory for Hamilton-Jacobi-Bellman (HJB) equations on the Wasserstein space using Mortensen's derivative. In particular, a comparison principle for viscosity solution is established. Our approach is based on Borwein-Preiss variational principle to overcome the loss of compactness for bounded sets in the Wasserstein space.


title: Tracking and Mapping in Medical Computer Vision: A Review

abstract: As computer vision algorithms increase in capability, their applications in clinical systems will become more pervasive. These applications include: diagnostics, such as colonoscopy and bronchoscopy; guiding biopsies, minimally invasive interventions, and surgery; automating instrument motion; and providing image guidance using pre-operative scans. Many of these applications depend on the specific visual nature of medical scenes and require designing algorithms to perform in this environment. In this review, we provide an update to the field of camera-based tracking and scene mapping in surgery and diagnostics in medical computer vision. We begin with describing our review process, which results in a final list of 515 papers that we cover. We then give a high-level summary of the state of the art and provide relevant background for those who need tracking and mapping for their clinical applications. After which, we review datasets provided in the field and the clinical needs that motivate their design. Then, we delve into the algorithmic side, and summarize recent developments. This summary should be especially useful for algorithm designers and to those looking to understand the capability of off-the-shelf methods. We maintain focus on algorithms for deformable environments while also reviewing the essential building blocks in rigid tracking and mapping since there is a large amount of crossover in methods. With the field summarized, we discuss the current state of the tracking and mapping methods along with needs for future algorithms, needs for quantification, and the viability of clinical applications. We then provide some research directions and questions. We conclude that new methods need to be designed or combined to support clinical applications in deformable environments, and more focus needs to be put into collecting datasets for training and evaluation.


title: Program Translation via Code Distillation

abstract: Software version migration and program translation are an important and costly part of the lifecycle of large codebases. Traditional machine translation relies on parallel corpora for supervised translation, which is not feasible for program translation due to a dearth of aligned data. Recent unsupervised neural machine translation techniques have overcome data limitations by included techniques such as back translation and low level compiler intermediate representations (IR). These methods face significant challenges due to the noise in code snippet alignment and the diversity of IRs respectively. In this paper we propose a novel model called Code Distillation (CoDist) whereby we capture the semantic and structural equivalence of code in a language agnostic intermediate representation. Distilled code serves as a translation pivot for any programming language, leading by construction to parallel corpora which scale to all available source code by simply applying the distillation compiler. We demonstrate that our approach achieves state-of-the-art performance on CodeXGLUE and TransCoder GeeksForGeeks translation benchmarks, with an average absolute increase of 12.7% on the TransCoder GeeksforGeeks translation benchmark compare to TransCoder-ST.


title: Robust-MBFD: A Robust Deep Learning System for Motor Bearing Faults Detection Using Multiple Deep Learning Training Strategies and A Novel Double Loss Function

abstract: This paper presents a comprehensive analysis of motor bearing fault detection (MBFD), which involves the task of identifying faults in a motor bearing based on its vibration. To this end, we first propose and evaluate various machine learning based systems for the MBFD task. Furthermore, we propose three deep learning based systems for the MBFD task, each of which explores one of the following training strategies: supervised learning, semi-supervised learning, and unsupervised learning. The proposed machine learning based systems and deep learning based systems are evaluated, compared, and then they are used to identify the best model for the MBFD task. We conducted extensive experiments on various benchmark datasets of motor bearing faults, including those from the American Society for Mechanical Failure Prevention Technology (MFPT), Case Western Reserve University Bearing Center (CWRU), and the Condition Monitoring of Bearing Damage in Electromechanical Drive Systems from Paderborn University (PU). The experimental results on different datasets highlight two main contributions of this study. First, we prove that deep learning based systems are more effective than machine learning based systems for the MBFD task. Second, we achieve a robust and general deep learning based system with a novel loss function for the MBFD task on several benchmark datasets, demonstrating its potential for real-life MBFD applications.


title: ASP: Automatic Selection of Proxy dataset for efficient AutoML

abstract: Deep neural networks have gained great success due to the increasing amounts of data, and diverse effective neural network designs. However, it also brings a heavy computing burden as the amount of training data is proportional to the training time. In addition, a well-behaved model requires repeated trials of different structure designs and hyper-parameters, which may take a large amount of time even with state-of-the-art (SOTA) hyper-parameter optimization (HPO) algorithms and neural architecture search (NAS) algorithms. In this paper, we propose an Automatic Selection of Proxy dataset framework (ASP) aimed to dynamically find the informative proxy subsets of training data at each epoch, reducing the training data size as well as saving the AutoML processing time. We verify the effectiveness and generalization of ASP on CIFAR10, CIFAR100, ImageNet16-120, and ImageNet-1k, across various public model benchmarks. The experiment results show that ASP can obtain better results than other data selection methods at all selection ratios. ASP can also enable much more efficient AutoML processing with a speedup of 2x-20x while obtaining better architectures and better hyper-parameters compared to utilizing the entire dataset.


title: On the Temperature of Bayesian Graph Neural Networks for Conformal Prediction

abstract: Accurate uncertainty quantification in graph neural networks (GNNs) is essential, especially in high-stakes domains where GNNs are frequently employed. Conformal prediction (CP) offers a promising framework for quantifying uncertainty by providing $\textit{valid}$ prediction sets for any black-box model. CP ensures formal probabilistic guarantees that a prediction set contains a true label with a desired probability. However, the size of prediction sets, known as $\textit{inefficiency}$, is influenced by the underlying model and data generating process. On the other hand, Bayesian learning also provides a credible region based on the estimated posterior distribution, but this region is $\textit{well-calibrated}$ only when the model is correctly specified. Building on a recent work that introduced a scaling parameter for constructing valid credible regions from posterior estimate, our study explores the advantages of incorporating a temperature parameter into Bayesian GNNs within CP framework. We empirically demonstrate the existence of temperatures that result in more efficient prediction sets. Furthermore, we conduct an analysis to identify the factors contributing to inefficiency and offer valuable insights into the relationship between CP performance and model calibration.


title: Whole-brain radiomics for clustered federated personalization in brain tumor segmentation

abstract: Federated learning and its application to medical image segmentation have recently become a popular research topic. This training paradigm suffers from statistical heterogeneity between participating institutions' local datasets, incurring convergence slowdown as well as potential accuracy loss compared to classical training. To mitigate this effect, federated personalization emerged as the federated optimization of one model per institution. We propose a novel personalization algorithm tailored to the feature shift induced by the usage of different scanners and acquisition parameters by different institutions. This method is the first to account for both inter and intra-institution feature shift (multiple scanners used in a single institution). It is based on the computation, within each centre, of a series of radiomic features capturing the global texture of each 3D image volume, followed by a clustering analysis pooling all feature vectors transferred from the local institutions to the central server. Each computed clustered decentralized dataset (potentially including data from different institutions) then serves to finetune a global model obtained through classical federated learning. We validate our approach on the Federated Brain Tumor Segmentation 2022 Challenge dataset (FeTS2022). Our code is available at (https://github.com/MatthisManthe/radiomics_CFFL).


title: Contracting Tsetlin Machine with Absorbing Automata

abstract: In this paper, we introduce a sparse Tsetlin Machine (TM) with absorbing Tsetlin Automata (TA) states. In brief, the TA of each clause literal has both an absorbing Exclude- and an absorbing Include state, making the learning scheme absorbing instead of ergodic. When a TA reaches an absorbing state, it will never leave that state again. If the absorbing state is an Exclude state, both the automaton and the literal can be removed from further consideration. The literal will as a result never participates in that clause. If the absorbing state is an Include state, on the other hand, the literal is stored as a permanent part of the clause while the TA is discarded. A novel sparse data structure supports these updates by means of three action lists: Absorbed Include, Include, and Exclude. By updating these lists, the TM gets smaller and smaller as the literals and their TA withdraw. In this manner, the computation accelerates during learning, leading to faster learning and less energy consumption.


title: Rethinking Class-incremental Learning in the Era of Large Pre-trained Models via Test-Time Adaptation

abstract: Class-incremental learning (CIL) is a challenging task that involves sequentially learning to categorize classes from new tasks without forgetting previously learned information. The advent of large pre-trained models (PTMs) has fast-tracked the progress in CIL due to the highly transferable PTM representations, where tuning a small set of parameters leads to state-of-the-art performance when compared with the traditional CIL methods that are trained from scratch. However, repeated fine-tuning on each task destroys the rich representations of the PTMs and further leads to forgetting previous tasks. To strike a balance between the stability and plasticity of PTMs for CIL, we propose a novel perspective of eliminating training on every new task and instead train PTM only on the first task, and then refine its representation at inference time using test-time adaptation (TTA). Concretely, we propose Test-Time Adaptation for Class-Incremental Learning (TTACIL) that first fine-tunes PTMs using Adapters on the first task, then adjusts Layer Norm parameters of the PTM on each test instance for learning task-specific features, and finally resets them back to the adapted model to preserve stability. As a consequence, our TTACIL does not undergo any forgetting, while benefiting each task with the rich PTM features. Additionally, by design, our TTACIL is robust to common data corruptions. Our method outperforms several state-of-the-art CIL methods when evaluated on multiple CIL benchmarks under both clean and corrupted data. Code is available at: https://github.com/IemProg/TTACIL.


title: Pawlak, Belnap and the magical number seven

abstract: We are considering the algebraic structure of the Pawlak-Brouwer-Zadeh lattice to distinguish vagueness due to imprecision from ambiguity due to coarseness. We show that a general class of many-valued logics useful for reasoning about data emerges from this context. All these logics can be obtained from a very general seven-valued logic which, interestingly enough, corresponds to a reasoning system developed by Jaina philosophers four centuries BC. In particular, we show how the celebrated Belnap four-valued logic can be obtained from the very general seven-valued logic based on the Pawlak-Brouwer-Zadeh lattice.


title: Speeding up qubit control with bipolar single-flux-quantum pulse sequences

abstract: The development of quantum computers based on superconductors requires the improvement of the qubit state control approach aimed at the increase of the hardware energy efficiency. A promising solution to this problem is the use of superconducting digital circuits operating with single-flux-quantum (SFQ) pulses, moving the qubit control system into the cold chamber. However, the qubit gate time under SFQ control is still longer than under conventional microwave driving. Here we introduce the bipolar SFQ pulse control based on ternary pulse sequences. We also develop a robust optimization algorithm for finding a sequence structure that minimizes the leakage of the transmon qubit state from the computational subspace. We show that the appropriate sequence can be found for arbitrary system parameters from the practical range. The proposed bipolar SFQ control reduces a single qubit gate time by halve compared to nowadays unipolar SFQ technique, while maintaining the gate fidelity over 99.99%.


title: Approximate Expressions for the Capillary Force and the Surface Area of a Liquid Bridge between Identical Spheres

abstract: We consider a liquid bridge between two identical spheres and provide approximate expressions for the capillary force and the exposed surface area of the liquid bridge as functions of the liquid bridge's total volume and the sphere separation distance. The radius of the spheres and the solid-liquid contact angle are parameters that enter the expressions. These expressions are needed for efficient numerical simulations of drying suspensions.


title: End-to-End real time tracking of children's reading with pointer network

abstract: In this work, we explore how a real time reading tracker can be built efficiently for children's voices. While previously proposed reading trackers focused on ASR-based cascaded approaches, we propose a fully end-to-end model making it less prone to lags in voice tracking. We employ a pointer network that directly learns to predict positions in the ground truth text conditioned on the streaming speech. To train this pointer network, we generate ground truth training signals by using forced alignment between the read speech and the text being read on the training set. Exploring different forced alignment models, we find a neural attention based model is at least as close in alignment accuracy to the Montreal Forced Aligner, but surprisingly is a better training signal for the pointer network. Our results are reported on one adult speech data (TIMIT) and two children's speech datasets (CMU Kids and Reading Races). Our best model can accurately track adult speech with 87.8% accuracy and the much harder and disfluent children's speech with 77.1% accuracy on CMU Kids data and a 65.3% accuracy on the Reading Races dataset.


title: Jets with a Twist: Emergence of FR0 Jets in 3D GRMHD Simulation of Zero Angular Momentum Black Hole Accretion

abstract: Spinning supermassive black holes (BHs) in active galactic nuclei (AGN) magnetically launch relativistic collimated outflows, or jets. Without angular momentum supply, such jets are thought to perish within $3$ orders of magnitude in distance from the BH, well before reaching kpc-scales. We study the survival of such jets at the largest scale separation to date, via 3D general relativistic magnetohydrodynamic simulations of rapidly spinning BHs immersed into uniform zero-angular-momentum gas threaded by weak vertical magnetic field. We place the gas outside the BH sphere of influence, or the Bondi radius, chosen much larger than the BH gravitational radius, $R_\text{B}=10^3R_\text{g}$. The BH develops dynamically-important large-scale magnetic fields, forms a magnetically-arrested disk (MAD), and launches relativistic jets that propagate well outside $R_\text{B}$ and suppress BH accretion to $1.5\%$ of the Bondi rate, $\dot{M}_\text{B}$. Thus, low-angular-momentum accretion in the MAD state can form large-scale jets in Fanaroff-Riley (FR) type I and II galaxies. Subsequently, the disk shrinks and exits the MAD state: barely a disk (BAD), it rapidly precesses, whips the jets around, globally destroys them, and lets $5-10\%$ of $\dot{M}_\text{B}$ reach the BH. Thereafter, the disk starts rocking back and forth by angles $90-180^\circ$: the rocking accretion disk (RAD) launches weak intermittent jets that spread their energy over a large area and suppress BH accretion to $\lesssim 2 \% ~ \dot{M}_\text{B}$. Because BAD and RAD states tangle up the jets and destroy them well inside $R_\text{B}$, they are promising candidates for the more abundant, but less luminous, class of FR0 galaxies.


title: Dark Energy as a Critical Period in Binary Motion: Bounds from Multi-scale Binaries

abstract: The two-body problem under the influence of both dark energy and post-Newtonian modifications is studied. In this unified framework, we demonstrate that dark energy plays the role of a critical period with $T_{\Lambda} = 2\pi/c \sqrt{\Lambda} \approx 60~\text{Gyr}$. We also show that the ratio between orbital and critical period naturally emerges from the Kretschmann scalar, which is a quadratic curvature invariant characterizing all binary systems effectively represented by a de Sitter-Schwarzschild spacetime. The suitability of a binary system to constrain dark energy is determined by the ratio between its Keplerian orbital period $T_\text{K}$ and the critical period $T_\Lambda$. Systems with $T_\text{K} \approx T_\Lambda$ are optimal for constraining the cosmological constant $\Lambda$, such as the Local Group and the Virgo Cluster. Systems with $T_{\text{K}} \ll T_\Lambda$ are dominated by attractive gravity (which are best suited for studying modified gravity corrections). Systems with $T_{\text{K}} \gg T_\Lambda$ are dominated by repulsive dark energy and can thus be used to constrain $\Lambda$ from below. We use our unified framework of post-Newtonian and dark-energy modifications to calculate the precession of bounded and unbounded astrophysical systems and infer constraints on $\Lambda$ from them. Pulsars, the solar system, S stars around Sgr A*, the Local Group, and the Virgo Cluster, having orbital periods of days to gigayears, are analyzed. The results reveal that the upper bound on the cosmological constant decreases when the orbital period of the system increases, emphasizing that $\Lambda$ is a critical period in binary motion.

categories: astro-ph.CO astro-ph.GA astro-ph.SR gr-qc hep-ph


title: Quantum geometry induced nonlinear transport in altermagnets

abstract: Quantum geometry plays a pivotal role in the second-order response of $\cal PT$-symmetric antiferromagnets. Here we study the nonlinear response of 2D altermagnets protected by $C_n\cal T$ symmetry and show that their leading nonlinear response is third-order. Furthermore, we show that the contributions from the quantum metric and Berry curvature enter separately: the longitudinal response for all planar altermagnets \emph{only} has a contribution from the quantum metric quadrupole (QMQ), while transverse responses in general have contributions from both the Berry curvature quadrupole (BCQ) and QMQ. We show that for the well-known example of $d$-wave altermagnets the Hall response is dominated by the BCQ. Both longitudinal and transverse responses are strongly dependent on the crystalline anisotropy. While altermagnets are strictly defined in the limit of vanishing SOC, real altermagnets exhibit weak SOC, which is essential to observe this response. Specifically, SOC gaps the spin-group protected nodal line, generating a response peak that is sharpest when SOC is weak. Two Dirac nodes also contribute a divergence to the nonlinear response, whose scaling changes as a function of SOC. Finally, we apply our results to thin films of the 3D altermagnet RuO$_2$. Our work uncovers distinct features of altermagnets in nonlinear transport, providing experimental signatures as well as a guide to disentangling the different components of their quantum geometry.


title: Winds and Disk Turbulence Exert Equal Torques on Thick Magnetically Arrested Disks

abstract: The conventional accretion disk lore is that magnetized turbulence is the principal angular momentum transport process that drives accretion. However, when dynamically important large-scale magnetic fields thread an accretion disk, they can produce mass and angular momentum outflows, known as winds, that also drive accretion. Yet, the relative importance of turbulent and wind-driven angular momentum transport is still poorly understood. To probe this question, we analyze a long-duration ($1.2 \times 10^5 r_{\rm g}/c$) simulation of a rapidly rotating ($a=0.9$) black hole feeding from a thick ($H/r\sim0.3$), adiabatic, magnetically arrested disk (MAD), whose dynamically important magnetic field regulates mass inflow and drives both uncollimated and collimated outflows (i.e., winds and jets, respectively). By carefully disentangling the various angular momentum transport processes within the system, we demonstrate the novel result that disk winds and disk turbulence both extract roughly equal amounts of angular momentum from the disk. We find cumulative angular momentum and mass accretion outflow rates of $\dot{L}\propto r^{0.9}$ and $\dot{M}\propto r^{0.4}$, respectively. This result suggests that understanding both turbulent and laminar stresses is key to understanding the evolution of systems where geometrically thick MADs can occur, such as the hard state of X-ray binaries, low-luminosity active galactic nuclei, some tidal disruption events, and possibly gamma-ray bursts.


title: Constraints on thermal conductivity in the merging cluster Abell 2146

abstract: The cluster of galaxies Abell 2146 is undergoing a major merger and is an ideal cluster to study ICM physics, as it has a simple geometry with the merger axis in the plane of the sky, its distance allows us to resolve features across the relevant scales and its temperature lies within Chandra's sensitivity. Gas from the cool core of the subcluster has been partially stripped into a tail of gas, which gives a unique opportunity to look at the survival of such gas and determine the rate of conduction in the ICM. We use deep 2.4 Ms Chandra observations of Abell 2146 to produce a high spatial resolution map of the temperature structure along a plume in the ram-pressure stripped tail, described by a partial cone, which is distinguishable from the hot ambient gas. Previous studies of conduction in the ICM typically rely on estimates of the survival time for key structures, such as cold fronts. Here we use detailed hydrodynamical simulations of Abell 2146 to determine the flow velocities along the stripped plume and measure the timescale of the temperature increase along its length. We find that conduction must be highly suppressed by multiple orders of magnitude compared to the Spitzer rate, as the energy used is about 1% of the energy available. We discuss magnetic draping around the core as a possible mechanism for suppressing conduction.


title: On the natal kick of the black hole X-ray binary H 1705--250

abstract: When a compact object is formed, an impulse (kick) will be imparted to the system by the mass lost during the core-collapse supernova (SN). A number of other mechanisms may impart an additional kick on the system, although evidence for these natal kicks in black hole systems remains limited. Updated Gaia astrometry has recently identified a number of high peculiar velocity (in excess of Galactic motion) compact objects. Here, we focus on the black hole low-mass X-ray binary H 1705--250, which has a peculiar velocity $\upsilon_{\mathrm{pec}}\,=\,221^{+101}_{-108}\,\mathrm{km}\,\mathrm{s}^{-1}$. Using population synthesis to reconstruct its evolutionary history (assuming formation via isolated binary evolution within the Galactic plane), we constrain the properties of the progenitor and pre-SN orbit. The magnitude of a kick solely due to mass loss is found to be $\sim\,30\,\mathrm{km}\,\mathrm{s}^{-1}$, which cannot account for the high present-day peculiar motion. We therefore deduce that the black hole received an additional natal kick at formation, and place limits on its magnitude, finding it to be $\sim\,295\,\mathrm{km}\,\mathrm{s}^{-1}$ (minimum $90\,\mathrm{km}\,\mathrm{s}^{-1}$). This furthers the argument that these kicks are not limited to neutron stars.


title: $\Sigma_{\mathrm{SFR}}$-M* Diagram: A Valuable Galaxy Evolution Diagnostic to Complement (s)SFR-M* Diagrams

abstract: The specific star formation rate (sSFR) is commonly used to describe the level of galaxy star formation (SF) and to select quenched galaxies. However, being a relative measure of the young-to-old population, an ambiguity in its interpretation may arise because a small sSFR can be either because of a substantial previous mass build up, or because SF is low. We show, using large samples spanning 0 < z < 2, that the normalization of SFR by the physical extent over which SF is taking place (i.e., SFR surface density, $\Sigma_{\mathrm{SFR}}$) overcomes this ambiguity. $\Sigma_{\mathrm{SFR}}$ has a strong physical basis, being tied to the molecular gas density and the effectiveness of stellar feedback, so we propose $\Sigma_{\mathrm{SFR}}$-M* as an important galaxy evolution diagram to complement (s)SFR-M* diagrams. Using the $\Sigma_{\mathrm{SFR}}$-M* diagram we confirm the Schiminovich et al. (2007) result that the level of SF along the main sequence today is only weakly mass dependent - high-mass galaxies, despite their redder colors, are as active as blue, low-mass ones. At higher redshift, the slope of the "$\Sigma_{\mathrm{SFR}}$ main sequence" steepens, signaling the epoch of bulge build-up in massive galaxies. We also find that $\Sigma_{\mathrm{SFR}}$ based on the optical isophotal radius more cleanly selects both the starbursting and the spheroid-dominated (early-type) galaxies than sSFR. One implication of our analysis is that the assessment of the inside-out vs. outside-in quenching scenarios should consider both sSFR and $\Sigma_{\mathrm{SFR}}$ radial profiles, because ample SF may be present in bulges with low sSFR (red color).


title: String Thermodynamics In and Out of Equilibrium: Boltzmann Equations and Random Walks

abstract: We revisit the study of string theory close to the Hagedorn temperature with the aim towards cosmological applications. We consider interactions of open and closed strings in a gas of D$p-$branes, and/or one isolated D$p$-brane, in an arbitrary number $d$ of flat non-compact dimensions and general compact dimensions. Leading order string perturbation theory is used to obtain the basic interaction rates in a flat background, which are shown to be consistent with the random walk picture of highly excited strings that should apply in more general backgrounds. Using the random walk interpretation we infer the structure of more general semi-inclusive string scattering rates and then write down the corresponding Boltzmann equations describing ensembles of highly excited closed and open strings. We organise the interaction terms in Boltzmann equations so that detailed balance becomes manifest. We obtain the equilibrium solutions and show that they reduce to previously computed solutions for $d=0$. We further study the behaviour of non-equlibrium fluctuations and find explicit analytic expressions for the equilibration rates (and for the number of open strings in $d=0$). Potential implications for an early universe with strings at high temperatures are outlined.


title: Some stars fade quietly: Varied Supernova explosion outcomes and their effects on the multi-phase interstellar medium

abstract: We present results from galaxy evolution simulations with a mutiphase Interstellar medium (ISM), a mass resolution of $4$ M$_{\odot}$ and a spatial resolution of 0.5 pc. These simulations include a stellar feedback model that includes the resolved feedback from individual massive stars and accounts for heating from the far UV-field, non-equilibrium cooling and chemistry and photoionization. In the default setting, individual supernova (SN) remnants are realized as thermal injections of $10^{51}$ erg; this is our reference simulation WLM-fid. Among the remaining seven simulations, there are two runs where we vary this number by fixing the energy at $10^{50}$ erg and $10^{52}$ erg (WLM-1e50 and WLM-1e52, respectively). We carry out three variations with variable SN-energy based on the data of Sukhbold et al. (2016) (WLM-variable, WLM-variable-lin, and WLM-variable-stoch). We run two simulations where only 10 or 60 percent of stars explode as SNe with $10^{51}$ erg, while the remaining stars do not explode (WLM-60prob and WLM-10prob). We find that the variation in the SN-energy, based on the tables of Sukhbold et al. (2016), has only minor effects: the star formation rate changes by roughly a factor of two compared to the fiducial run, and the strength of the galactic outflows in mass and energy only decreases by roughly 30 percent, with typical values of $\eta_m \sim 0.1$ and $\eta_e \sim 0.05$ (measured at a height of 3 kpc after the hot wind is fully decoupled from the galactic ISM). In contrast, the increase and decrease in the canonical SN-energy has a clear impact on the phase structure, with loading factors that are at least 10 times lower/higher and a clear change in the phase structure. We conclude that these slight modulations are driven not by the minor change in SN-energy but rather by the stochasticity of whether or not an event occurs when variable SN-energies are applied.


title: The Peak of the Fallback Rate from Tidal Disruption Events: Dependence on Stellar Type

abstract: A star completely destroyed in a tidal disruption event (TDE) ignites a luminous flare that is powered by the fallback of tidally stripped debris to a supermassive black hole (SMBH) of mass $M_{\bullet}$. We analyze two estimates for the peak fallback rate in a TDE, one being the "frozen-in" model, which predicts a strong dependence of the time to peak fallback rate, $t_{\rm peak}$, on both stellar mass and age, with $15\textrm{ days} \lesssim t_{\rm peak} \lesssim 10$ yr for main sequence stars with masses $0.2\le M_{\star}/M_{\odot} \le 5$ and $M_{\bullet} = 10^6M_{\odot}$. The second estimate, which postulates that the star is completely destroyed when tides dominate the maximum stellar self-gravity, predicts that $t_{\rm peak}$ is very weakly dependent on stellar type, with $t_{\rm peak} = \left(23.2\pm4.0\textrm{ days}\right)\left(M_{\bullet}/10^6M_{\odot}\right)^{1/2}$ for $0.2\le M_{\star}/M_{\odot} \le 5$, while $t_{\rm peak} = \left(29.8\pm3.6\textrm{ days}\right)\left(M_{\bullet}/10^6M_{\odot}\right)^{1/2}$ for a Kroupa initial mass function truncated at $1.5 M_{\odot}$. This second estimate also agrees closely with hydrodynamical simulations, while the frozen-in model is discrepant by orders of magnitude. We conclude that (1) the time to peak luminosity in complete TDEs is almost exclusively determined by SMBH mass, and (2) massive-star TDEs power the largest accretion luminosities. Consequently, (a) decades-long extra-galactic outbursts cannot be powered by complete TDEs, including massive-star disruptions, and (b) the most highly super-Eddington TDEs are powered by the complete disruption of massive stars, which -- if responsible for producing jetted TDEs -- would explain the rarity of jetted TDEs and their preference for young and star-forming host galaxies.


title: Strong enhancement of superconductivity on finitely ramified fractal lattices

abstract: Using the Sierpinski gasket (triangle) and carpet (square) lattices as examples, we theoretically study the properties of fractal superconductors. For that, we focus on the phenomenon of $s$-wave superconductivity in the Hubbard model with attractive on-site potential and employ the Bogoliubov-de Gennes approach and the theory of superfluid stiffness. For the case of the Sierpinski gasket, we demonstrate that fractal geometry of the underlying crystalline lattice can be strongly beneficial for superconductivity, not only leading to a considerable increase of the critical temperature $T_c$ as compared to the regular triangular lattice but also supporting macroscopic phase coherence of the Cooper pairs. In contrast, the Sierpinski carpet geometry does not lead to pronounced effects, and we find no substantial difference as compared with the regular square lattice. We conjecture that the qualitative difference between these cases is caused by different ramification properties of the fractals.