title: Towards High Efficient Long-horizon Planning with Expert-guided Motion-encoding Tree Search

abstract: Autonomous driving holds promise for increased safety, optimized traffic management, and a new level of convenience in transportation. While model-based reinforcement learning approaches such as MuZero enables long-term planning, the exponentially increase of the number of search nodes as the tree goes deeper significantly effect the searching efficiency. To deal with this problem, in this paper we proposed the expert-guided motion-encoding tree search (EMTS) algorithm. EMTS extends the MuZero algorithm by representing possible motions with a comprehensive motion primitives latent space and incorporating expert policies toimprove the searching efficiency. The comprehensive motion primitives latent space enables EMTS to sample arbitrary trajectories instead of raw action to reduce the depth of the search tree. And the incorporation of expert policies guided the search and training phases the EMTS algorithm to enable early convergence. In the experiment section, the EMTS algorithm is compared with other four algorithms in three challenging scenarios. The experiment result verifies the effectiveness and the searching efficiency of the proposed EMTS algorithm.


title: Operators associated with the pentablock and their relations with biball and symmetrized bidisc

abstract: A commuting triple of Hilbert space operators $(A,S,P)$ is said to be a \textit{$\mathbb{P}$-contraction} if the closed pentablock $\overline{\mathbb P}$ is a spectral set for $(A,S,P)$, where \[ \mathbb{P}:=\left\{(a_{21}, \mbox{tr}(A_0), \mbox{det}(A_0))\ : \ A_0=[a_{ij}]_{2 \times 2} \; \; \& \;\; \|A_0\| <1 \right\} \subseteq \mathbb{C}^3. \] We find several characterizations for the $\mathbb P$-unitaries and $\mathbb P$-isometries. We show that every $\mathbb P$-isometry admits a Wold type decomposition that splits it into a direct sum of a $\mathbb P$-unitary and a pure $\mathbb P$-isometry. We also show that every $\mathbb P$-contraction $(A,S,P)$ possesses a canonical decomposition that orthogonally decomposes $(A,S,P)$ into a $\mathbb P$-unitary and a completely non-unitary $\mathbb P$-contraction. We find a necessary and sufficient condition such that a $\mathbb P$-contraction $(A, S, P)$ dilates to a $\mathbb P$-isometry $(X, T, V)$ with $V$ being the minimal isometric dilation of $P$. Then we show an explicit construction of such a conditional dilation. A commuting tuple of Hilbert space operators $(T_1, \dots , T_n)$ having the closed unit ball $\overline{\mathbb B}_n$ as a spectral set is called a $\mathbb B_n$-\textit{contraction} and a commuting pair $(S,P)$ having the closed symmetrized bidisc $\overline{\mathbb G_2} \,(=\Gamma)$ as a spectral set is called a $\Gamma$-\textit{contraction}. We characterize isometries and unitaries associated with $\mathbb B_n$. Then we present an analogous canonical decomposition for a $\mathbb B_n$-contraction. We show interplay between operator theory on the three domains $\mathbb P, \mathbb B_2$ and $\mathbb G_2$.


title: Challenges of building medical image datasets for development of deep learning software in stroke

abstract: Despite the large amount of brain CT data generated in clinical practice, the availability of CT datasets for deep learning (DL) research is currently limited. Furthermore, the data can be insufficiently or improperly prepared for machine learning and thus lead to spurious and irreproducible analyses. This lack of access to comprehensive and diverse datasets poses a significant challenge for the development of DL algorithms. In this work, we propose a complete semi-automatic pipeline to address the challenges of preparing a clinical brain CT dataset for DL analysis and describe the process of standardising this heterogeneous dataset. Challenges include handling image sets with different orientations (axial, sagittal, coronal), different image types (to view soft tissues or bones) and dimensions, and removing redundant background. The final pipeline was able to process 5,868/10,659 (45%) CT image datasets. Reasons for rejection include non-axial data (n=1,920), bone reformats (n=687), separated skull base/vault images (n=1,226), and registration failures (n=465). Further format adjustments, including image cropping, resizing and scaling are also needed for DL processing. Of the axial scans that were not localisers, bone reformats or split brains, 5,868/6,333 (93%) were accepted, while the remaining 465 failed the registration process. Appropriate preparation of medical imaging datasets for DL is a costly and time-intensive process.


title: RPEFlow: Multimodal Fusion of RGB-PointCloud-Event for Joint Optical Flow and Scene Flow Estimation

abstract: Recently, the RGB images and point clouds fusion methods have been proposed to jointly estimate 2D optical flow and 3D scene flow. However, as both conventional RGB cameras and LiDAR sensors adopt a frame-based data acquisition mechanism, their performance is limited by the fixed low sampling rates, especially in highly-dynamic scenes. By contrast, the event camera can asynchronously capture the intensity changes with a very high temporal resolution, providing complementary dynamic information of the observed scenes. In this paper, we incorporate RGB images, Point clouds and Events for joint optical flow and scene flow estimation with our proposed multi-stage multimodal fusion model, RPEFlow. First, we present an attention fusion module with a cross-attention mechanism to implicitly explore the internal cross-modal correlation for 2D and 3D branches, respectively. Second, we introduce a mutual information regularization term to explicitly model the complementary information of three modalities for effective multimodal feature learning. We also contribute a new synthetic dataset to advocate further research. Experiments on both synthetic and real datasets show that our model outperforms the existing state-of-the-art by a wide margin. Code and dataset is available at https://npucvr.github.io/RPEFlow.


title: Fluctuations in depth and associated primes of powers of ideals

abstract: We count the numbers of associated primes of powers of ideals as defined by Bandari, Hibi, and Herzog in 2014. We generalize those ideals to monomial ideals $\operatorname{BHH}(m,r,s)$ for $r \ge 2$, $m$, $s \ge 1$; we establish partially the associated primes of powers of these ideals, and we establish completely the depth function of quotients by powers of these ideals: the depth function is periodic of period $r$ repeated $m$ times on the initial interval before settling to a constant value. The number of needed variables for these depth functions are lower than those from general constructions by H\`{a}, Nguyen, Trung, and Trung (2021).


title: The Surveillance AI Pipeline

abstract: A rapidly growing number of voices argue that AI research, and computer vision in particular, is powering mass surveillance. Yet the direct path from computer vision research to surveillance has remained obscured and difficult to assess. Here, we reveal the Surveillance AI pipeline by analyzing three decades of computer vision research papers and downstream patents, more than 40,000 documents. We find the large majority of annotated computer vision papers and patents self-report their technology enables extracting data about humans. Moreover, the majority of these technologies specifically enable extracting data about human bodies and body parts. We present both quantitative and rich qualitative analysis illuminating these practices of human data extraction. Studying the roots of this pipeline, we find that institutions that prolifically produce computer vision research, namely elite universities and "big tech" corporations, are subsequently cited in thousands of surveillance patents. Further, we find consistent evidence against the narrative that only these few rogue entities are contributing to surveillance. Rather, we expose the fieldwide norm that when an institution, nation, or subfield authors computer vision papers with downstream patents, the majority of these papers are used in surveillance patents. In total, we find the number of papers with downstream surveillance patents increased more than five-fold between the 1990s and the 2010s, with computer vision research now having been used in more than 11,000 surveillance patents. Finally, in addition to the high levels of surveillance we find documented in computer vision papers and patents, we unearth pervasive patterns of documents using language that obfuscates the extent of surveillance. Our analysis reveals the pipeline by which computer vision research has powered the ongoing expansion of surveillance.


title: Statistics of Moduli Space of vector bundles II

abstract: Let $X$ be a smooth irreducible projective curve of genus $g \geq 2$ over a finite field $\F_{q}$ of characteristic $p$ with $q$ elements such that the function field $\F_{q}(X)$ is a geometric Galois extension of the rational function field of degree $N.$ Consider $gcd(n,d)=1$, let $M_{L}(n,d)$ be the moduli space of rank $n$ stable vector bundles over $X$ with fixed determinant isomorphic to a $\mathbb F_q$-rational line bundle $L$. Suppose $N_q (M_L(n,d))$ denotes the cardinality of the set of $\F_{q}$-rational points of $M_{L}(n,d)$. We give an asymptotic bound of $\log(N_{q}(M_{L}(n,d)) - (n^2-1)(g-1)\log{q})$ for large genus $g,$ depending on $N$. Further, considering this logarithmic difference as a random variable, we prove a central limit theorem over a large family of hyperelliptic curves with uniform probability measure. Further, over the same family of hyperelliptic curves, we study the distribution of $\F_{q}$-rational points over the moduli space of rank $2$ stable vector bundles with trivial determinant $M^{s}_{\mathcal{O}_{H}}(2,0)$ and it's Seshadri desingularisation ${\widetilde{N}}$ by choosing an appropriate random variable in each case. We also see that the corresponding random variables having standard Gaussian distribution as $g$ and $q$ tends to infinity.


title: Video-adverb retrieval with compositional adverb-action embeddings

abstract: Retrieving adverbs that describe an action in a video poses a crucial step towards fine-grained video understanding. We propose a framework for video-to-adverb retrieval (and vice versa) that aligns video embeddings with their matching compositional adverb-action text embedding in a joint embedding space. The compositional adverb-action text embedding is learned using a residual gating mechanism, along with a novel training objective consisting of triplet losses and a regression target. Our method achieves state-of-the-art performance on five recent benchmarks for video-adverb retrieval. Furthermore, we introduce dataset splits to benchmark video-adverb retrieval for unseen adverb-action compositions on subsets of the MSR-VTT Adverbs and ActivityNet Adverbs datasets. Our proposed framework outperforms all prior works for the generalisation task of retrieving adverbs from videos for unseen adverb-action compositions. Code and dataset splits are available at https://hummelth.github.io/ReGaDa/.


title: Privacy-preserving and Privacy-attacking Approaches for Speech and Audio -- A Survey

abstract: In contemporary society, voice-controlled devices, such as smartphones and home assistants, have become pervasive due to their advanced capabilities and functionality. The always-on nature of their microphones offers users the convenience of readily accessing these devices. However, recent research and events have revealed that such voice-controlled devices are prone to various forms of malicious attacks, hence making it a growing concern for both users and researchers to safeguard against such attacks. Despite the numerous studies that have investigated adversarial attacks and privacy preservation for images, a conclusive study of this nature has not been conducted for the audio domain. Therefore, this paper aims to examine existing approaches for privacy-preserving and privacy-attacking strategies for audio and speech. To achieve this goal, we classify the attack and defense scenarios into several categories and provide detailed analysis of each approach. We also interpret the dissimilarities between the various approaches, highlight their contributions, and examine their limitations. Our investigation reveals that voice-controlled devices based on neural networks are inherently susceptible to specific types of attacks. Although it is possible to enhance the robustness of such models to certain forms of attack, more sophisticated approaches are required to comprehensively safeguard user privacy.


title: RankVicuna: Zero-Shot Listwise Document Reranking with Open-Source Large Language Models

abstract: Researchers have successfully applied large language models (LLMs) such as ChatGPT to reranking in an information retrieval context, but to date, such work has mostly been built on proprietary models hidden behind opaque API endpoints. This approach yields experimental results that are not reproducible and non-deterministic, threatening the veracity of outcomes that build on such shaky foundations. To address this significant shortcoming, we present RankVicuna, the first fully open-source LLM capable of performing high-quality listwise reranking in a zero-shot setting. Experimental results on the TREC 2019 and 2020 Deep Learning Tracks show that we can achieve effectiveness comparable to zero-shot reranking with GPT-3.5 with a much smaller 7B parameter model, although our effectiveness remains slightly behind reranking with GPT-4. We hope our work provides the foundation for future research on reranking with modern LLMs. All the code necessary to reproduce our results is available at https://github.com/castorini/rank_llm.


title: Equivariant Floer homotopy via Morse-Bott theory

abstract: We generalize the Cohen-Jones-Segal construction to the Morse-Bott setting. In other words, we define framings for Morse-Bott analogues of flow categories and associate a stable homotopy type to this data. We use this to recover the stable homotopy type of a closed manifold from Morse-Bott theory, and the stable equivariant homotopy type of a closed manifold with the action of a compact Lie group from Morse theory. We use this machinery in Floer theory to construct a genuine circle equivariant model for symplectic cohomology with coefficients in the sphere spectrum. Using the formalism of relative modules, we define equivariant maps to (Thom spectra over) the free loop space of exact, compact Lagrangians. We prove that this map is an equivalence of Borel equivariant spectra when the Lagrangian is the zero section of a cotangent bundle -- an equivariant Viterbo isomorphism theorem over the sphere spectrum.


title: Single Biological Neurons as Temporally Precise Spatio-Temporal Pattern Recognizers

abstract: This PhD thesis is focused on the central idea that single neurons in the brain should be regarded as temporally precise and highly complex spatio-temporal pattern recognizers. This is opposed to the prevalent view of biological neurons as simple and mainly spatial pattern recognizers by most neuroscientists today. In this thesis, I will attempt to demonstrate that this is an important distinction, predominantly because the above-mentioned computational properties of single neurons have far-reaching implications with respect to the various brain circuits that neurons compose, and on how information is encoded by neuronal activity in the brain. Namely, that these particular "low-level" details at the single neuron level have substantial system-wide ramifications. In the introduction we will highlight the main components that comprise a neural microcircuit that can perform useful computations and illustrate the inter-dependence of these components from a system perspective. In chapter 1 we discuss the great complexity of the spatio-temporal input-output relationship of cortical neurons that are the result of morphological structure and biophysical properties of the neuron. In chapter 2 we demonstrate that single neurons can generate temporally precise output patterns in response to specific spatio-temporal input patterns with a very simple biologically plausible learning rule. In chapter 3, we use the differentiable deep network analog of a realistic cortical neuron as a tool to approximate the gradient of the output of the neuron with respect to its input and use this capability in an attempt to teach the neuron to perform nonlinear XOR operation. In chapter 4 we expand chapter 3 to describe extension of our ideas to neuronal networks composed of many realistic biological spiking neurons that represent either small microcircuits or entire brain regions.


title: VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planning

abstract: Although recent text-to-video (T2V) generation methods have seen significant advancements, most of these works focus on producing short video clips of a single event with a single background (i.e., single-scene videos). Meanwhile, recent large language models (LLMs) have demonstrated their capability in generating layouts and programs to control downstream visual modules such as image generation models. This raises an important question: can we leverage the knowledge embedded in these LLMs for temporally consistent long video generation? In this paper, we propose VideoDirectorGPT, a novel framework for consistent multi-scene video generation that uses the knowledge of LLMs for video content planning and grounded video generation. Specifically, given a single text prompt, we first ask our video planner LLM (GPT-4) to expand it into a 'video plan', which involves generating the scene descriptions, the entities with their respective layouts, the background for each scene, and consistency groupings of the entities and backgrounds. Next, guided by this output from the video planner, our video generator, Layout2Vid, has explicit control over spatial layouts and can maintain temporal consistency of entities/backgrounds across scenes, while only trained with image-level annotations. Our experiments demonstrate that VideoDirectorGPT framework substantially improves layout and movement control in both single- and multi-scene video generation and can generate multi-scene videos with visual consistency across scenes, while achieving competitive performance with SOTAs in open-domain single-scene T2V generation. We also demonstrate that our framework can dynamically control the strength for layout guidance and can also generate videos with user-provided images. We hope our framework can inspire future work on better integrating the planning ability of LLMs into consistent long video generation.


title: Formation of the hydrogen line 21-cm in Dark Ages and Cosmic Dawn: dependences on cosmology and first light

abstract: We analyze the formation of the redshifted hyperfine structure line 21-cm of hydrogen atom in the Dark Ages, Cosmic Dawn, and Reionization epochs. The evolution of the global differential brightness temperature in this line was computed to study its dependence on the values of cosmological parameters and physical conditions in the intergalactic medium. Variations of the depth of the Dark Ages absorption line at $z\sim80$ with variations of the cosmological parameters $\Omega_b$, $\Omega_{cdm}$, $\Omega_{\Lambda}$, $\Omega_K$ and $H_0$ are studied. The standard model with post-Planck parameters predicts a value of the differential brightness temperature in the center of the absorption line $\sim$30-50 mK. The profile of this line can be quite another in the non-standard cosmological models, which include the annihilating or decaying dark matter, a primordial stochastic magnetic field, etc. It can be shallower or be an emission bump instead of an absorption trough. It is also shown that the position and depth of the Cosmic Dawn absorption line formed at 10<z<30, due to the Wouthuysen-Field effect, is mainly defined by the spectral energy distribution of the first sources of light. If reionization occurs at $z_{ri}=7\pm1$, then the differential brightness temperature in the center of this line is $\sim$80 mK. During the reionization, the emission with an amplitude of $\sim$20 mK is possible. It is also shown that the temperature, density, and degree of ionization of the baryonic component are decisive in calculating the intensity of the 21-cm absorption/emission line from these epochs.


title: Point-symmetry in SNR G1.9+0.3: A supernova that destroyed its planetary nebula progenitor

abstract: I analyze a new X-ray image of the youngest supernova remnant (SNR) in the Galaxy, which is the type Ia SNR G1.9+0.3, and reveal a very clear point-symmetrical structure. Since explosion models of type Ia supernovae (SNe Ia) do not form such morphologies, the point-symmetrical morphology must come from the circumstellar material (CSM) into which the ejecta expands. The large-scale point-symmetry that I identify and the known substantial deceleration of the ejecta of SNR G1.9+0.3 suggest a relatively massive CSM of >1Mo. I argue that the most likely explanation is the explosion of this SN Ia into a planetary nebula (PN). The scenario that predicts a large fraction of SN Ia inside PNe (SNIPs) is the core degenerate scenario. Other SN Ia scenarios might lead to only a very small fraction of SNIPs or not at all.


title: Identifying Simulation Model Through Alternative Techniques for a Medical Device Assembly Process

abstract: This scientific paper explores two distinct approaches for identifying and approximating the simulation model, particularly in the context of the snap process crucial to medical device assembly. Simulation models play a pivotal role in providing engineers with insights into industrial processes, enabling experimentation and troubleshooting before physical assembly. However, their complexity often results in time-consuming computations. To mitigate this complexity, we present two distinct methods for identifying simulation models: one utilizing Spline functions and the other harnessing Machine Learning (ML) models. Our goal is to create adaptable models that accurately represent the snap process and can accommodate diverse scenarios. Such models hold promise for enhancing process understanding and aiding in decision-making, especially when data availability is limited.


title: Strong pairing from small Fermi surface beyond weak coupling: Application to La$_3$Ni$_2$O$_7$

abstract: The studies of high-temperature superconductors raise a fundamental question: Can a small Fermi surface phase, which violates the Luttinger theorem, exist and give rise to superconductivity? Our work provides a positive answer through a controlled theory based on a bilayer model with strong inter-layer spin-spin coupling ($J_\perp$) but no inter-layer hopping ($t_\perp$). Then small hole doping of the rung-singlet insulator with two electrons per rung naturally leads to small hole pockets with Fermi surface volume per flavor smaller than the free fermion result by $1/2$ of the Brillouin zone(BZ). We construct a new t-J model on a bilayer square lattice, so called ESD t-J model and employ a generalized slave boson theory, which captures this small Fermi surface phase at small hole doping $x$. This metallic state is an intrinsically strongly correlated Fermi liquid beyond weak coupling theory, violating the perturbative Luttinger theorem but consistent with the Oshikawa's non-perturbative proof. We further show that it transitions into an inter-layer paired $s'$-wave superconductor at lower temperature through Feshbach resonance with a virtual Cooper pair, with a surprising doping-induced crossover from Bardeen-Cooper-Schrieffer (BCS) to Bose-Einstein condensation (BEC) at higher hole doping levels. This leads to a superconducting dome centered around $x=0.5$, with the normal state changing from the conventional Fermi liquid in the $x>0.5$ to the unusual small Fermi surface state in the $x<0.5$ side. Our theoretical findings including phase diagrams are also confirmed by density matrix renormalization group (DMRG) simulation in quasi one dimension. Applying our theoretical framework, we provide a plausible scenario for the recently found nickelate La$_3$Ni$_2$O$_7$ materials.


title: Fixing the NTK: From Neural Network Linearizations to Exact Convex Programs

abstract: Recently, theoretical analyses of deep neural networks have broadly focused on two directions: 1) Providing insight into neural network training by SGD in the limit of infinite hidden-layer width and infinitesimally small learning rate (also known as gradient flow) via the Neural Tangent Kernel (NTK), and 2) Globally optimizing the regularized training objective via cone-constrained convex reformulations of ReLU networks. The latter research direction also yielded an alternative formulation of the ReLU network, called a gated ReLU network, that is globally optimizable via efficient unconstrained convex programs. In this work, we interpret the convex program for this gated ReLU network as a Multiple Kernel Learning (MKL) model with a weighted data masking feature map and establish a connection to the NTK. Specifically, we show that for a particular choice of mask weights that do not depend on the learning targets, this kernel is equivalent to the NTK of the gated ReLU network on the training data. A consequence of this lack of dependence on the targets is that the NTK cannot perform better than the optimal MKL kernel on the training set. By using iterative reweighting, we improve the weights induced by the NTK to obtain the optimal MKL kernel which is equivalent to the solution of the exact convex reformulation of the gated ReLU network. We also provide several numerical simulations corroborating our theory. Additionally, we provide an analysis of the prediction error of the resulting optimal kernel via consistency results for the group lasso.


title: Case Study: Ensemble Decision-Based Annotation of Unconstrained Real Estate Images

abstract: We describe a proof-of-concept for annotating real estate images using simple iterative rule-based semi-supervised learning. In this study, we have gained important insights into the content characteristics and uniqueness of individual image classes as well as essential requirements for a practical implementation.


title: Attention Satisfies: A Constraint-Satisfaction Lens on Factual Errors of Language Models

abstract: We investigate the internal behavior of Transformer-based Large Language Models (LLMs) when they generate factually incorrect text. We propose modeling factual queries as constraint satisfaction problems and use this framework to investigate how the LLM interacts internally with factual constraints. We find a strong positive relationship between the LLM's attention to constraint tokens and the factual accuracy of generations. We curate a suite of 10 datasets containing over 40,000 prompts to study the task of predicting factual errors with the Llama-2 family across all scales (7B, 13B, 70B). We propose SAT Probe, a method probing attention patterns, that can predict factual errors and fine-grained constraint satisfaction, and allow early error identification. The approach and findings take another step towards using the mechanistic understanding of LLMs to enhance their reliability.


title: Seimei KOOLS-IFU mapping of the gas and dust distributions in Galactic PNe: Unveiling the origin and evolution of Galactic halo PN H4-1

abstract: H4-1 is a planetary nebula (PN) located in the Galactic halo, and is notably carbon-rich and one of the most metal-deficient PNe in the Milky Way. To unveil its progenitor evolution through the accurate measurement of the gas mass, we conducted a comprehensive investigation of H4-1, using the newly obtained Seimei/KOOLS-IFU spectra and multiwavelength spectro-photometry data. The emission line images generated from the KOOLS-IFU datacube successfully resolve the ellipsoidal nebula and the equatorial flattened disk that are frequently seen in bipolar PNe evolved from massive progenitors. By a fully data-driven method, we directly derived the seven elemental abundances, the gas-to-dust mass ratio, and the gas and dust masses based on our own distance scale. By comparing the observed quantities with both the photoionization model and the binary nucleosynthesis model, we conclude that the progenitors of an initial mass of 1.87 Msun and 0.82 Msun are second generation stars formed ~4 Gyrs after the Big Bang, and underwent mass-transfers, binary merger, and ultimately evolved into a PN showing unique chemical abundances. Our binary model successfully reproduces the observed abundances and also explains evolutionary time scale of H4-1.


title: SuperGaN: Synthesis of NbTiN/GaN/NbTiN Tunnel Junctions

abstract: Nb-based circuits have broad applications in quantum-limited photon detectors, low-noise parametric amplifiers, superconducting digital logic circuits, and low-loss circuits for quantum computing. The current state-of-the-art approach for superconductor-insulator-superconductor (SIS) junction material is the Gurvitch trilayer process based on magnetron sputtering of Nb electrodes with Al-Oxide or AlN tunnel barriers grown on an Al overlayer. However, a current limitation of elemental Nb-based circuits is the low-loss operation of THz circuits operating above the 670 GHz gap frequency of Nb and operation at higher temperatures for projects with a strict power budget, such as space-based applications. NbTiN is an alternative higher energy gap material and we have previously reported on the first NbTiN/AlN/NbTiN superconducting-insulating-superconducting (SIS) junctions with an epitaxially grown AlN tunnel barrier. One drawback of a directly grown tunnel barrier compared to thermal oxidation or plasma nitridation is control of the barrier thickness and uniformity across a substrate, leading to variations in current density (Jc). Semiconductor barriers with smaller barrier heights enable thicker tunnel barriers for a given Jc. GaN is an alternative semiconductor material with a closed-packed Wurtzite crystal structure similar to AlN and it can be epitaxially grown as a tunnel barrier using the Reactive Bias Target Ion Beam Deposition (RBTIBD) technique. This work presents the preliminary results of the first reported high-quality NbTiN/GaN/NbTiN heterojunctions with underdamped SIS I(V) characteristics.


title: Local Positional Encoding for Multi-Layer Perceptrons

abstract: A multi-layer perceptron (MLP) is a type of neural networks which has a long history of research and has been studied actively recently in computer vision and graphics fields. One of the well-known problems of an MLP is the capability of expressing high-frequency signals from low-dimensional inputs. There are several studies for input encodings to improve the reconstruction quality of an MLP by applying pre-processing against the input data. This paper proposes a novel input encoding method, local positional encoding, which is an extension of positional and grid encodings. Our proposed method combines these two encoding techniques so that a small MLP learns high-frequency signals by using positional encoding with fewer frequencies under the lower resolution of the grid to consider the local position and scale in each grid cell. We demonstrate the effectiveness of our proposed method by applying it to common 2D and 3D regression tasks where it shows higher-quality results compared to positional and grid encodings, and comparable results to hierarchical variants of grid encoding such as multi-resolution grid encoding with equivalent memory footprint.


title: Quantum geodesic flow on the integer lattice line

abstract: We use a recent formalism of quantum geodesics in noncommutative geometry to construct geodesic flow on the infinite chain $\cdots\bullet$--$\bullet$--$\bullet\cdots$. We find that noncommutative effects due to the discretisation of the line cause an initially real geodesic flow amplitude $\psi$ (for which the density is $|\psi|^2$) to become complex. This has been noted also for other quantum geometries and suggests that the complex nature of the wave function in quantum mechanics (and the interference effects that follow) may have its origin in a quantum/discrete nature of spacetime at the Planck scale.


title: LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Models

abstract: This work aims to learn a high-quality text-to-video (T2V) generative model by leveraging a pre-trained text-to-image (T2I) model as a basis. It is a highly desirable yet challenging task to simultaneously a) accomplish the synthesis of visually realistic and temporally coherent videos while b) preserving the strong creative generation nature of the pre-trained T2I model. To this end, we propose LaVie, an integrated video generation framework that operates on cascaded video latent diffusion models, comprising a base T2V model, a temporal interpolation model, and a video super-resolution model. Our key insights are two-fold: 1) We reveal that the incorporation of simple temporal self-attentions, coupled with rotary positional encoding, adequately captures the temporal correlations inherent in video data. 2) Additionally, we validate that the process of joint image-video fine-tuning plays a pivotal role in producing high-quality and creative outcomes. To enhance the performance of LaVie, we contribute a comprehensive and diverse video dataset named Vimeo25M, consisting of 25 million text-video pairs that prioritize quality, diversity, and aesthetic appeal. Extensive experiments demonstrate that LaVie achieves state-of-the-art performance both quantitatively and qualitatively. Furthermore, we showcase the versatility of pre-trained LaVie models in various long video generation and personalized video synthesis applications.


title: Efficient, traceable, and numerical error-free implementation of the MMS voting rule

abstract: I propose an alternative algorithm to compute the MMS voting rule. Instead of using linear programming, in this new algorithm the maximin support value of a committee is computed using a sequence of maximum flow problems.


title: On the minimal algebraic complexity of the rank-one approximation problem for general inner products

abstract: We study the algebraic complexity of Euclidean distance minimization from a generic tensor to a variety of rank-one tensors. The Euclidean Distance (ED) degree of the Segre-Veronese variety counts the number of complex critical points of this optimization problem. We regard this invariant as a function of inner products and conjecture that it achieves its minimal value at Frobenius inner product. We prove our conjecture in the case of matrices. We discuss the above optimization problem for other algebraic varieties, classifying all possible values of the ED degree. Our approach combines tools from Singularity Theory, Morse Theory, and Algebraic Geometry.


title: Improved constraints for axion-like particles from 3-photon events at $e^+e^-$ colliders

abstract: Axions and axion-like particles (ALPs) are one of the most widely discussed extensions of the Standard Model when it comes to the strong CP problem and dark matter candidates. Current experiments are focused on the indirect searches of invisible pseudoscalars in a wide parameter range. In this paper we investigate limits on ALP mass, and its couplings to photons and leptons from 3-photon annihilation at $e^+e^-$ colliders. We provide detailed calculations and apply them to the particular kinematics of the Belle II experiment, covering the ALP mass range from few hundred MeV to around 10 GeV. Our results, which improve upon previous analyses by also including the ALP coupling to electrons, show that such future analyses will allow to significantly extend the ALP search range and impose much more stringent restrictions on their couplings.


title: AdS$_3$ Vacuum State from Four Minkowski Vacuum States

abstract: We show that a tensor product of four specific $1{+}2$ Minkowski vacuum states is a self-consistent vacuum state for an infinite set of three-dimensional anti-de Sitter (AdS$_3$) spacetimes if their parity and time-reversal symmetry are broken in a particular way. The infinite set consists of pairs of all AdS$_3$ with non-zero unique scalar curvatures.


title: New solution to Airy's equation for modeling beams near turning points

abstract: Here I present a summarised description of the general behavior of waves near turning points. I show that when asymptotic matching to a prescribed incident wavefield is performed, the solution changes from being the Airy function to being more generally the hyperbolic umbilic function. This solution accounts for (de-)focusing of the incident wavefield due to gradient-index lensing in addition to the familiar Airy physics, which importantly do not superimpose. Possible applications to fusion research are discussed.


title: DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillation

abstract: 3D perception based on the representations learned from multi-camera bird's-eye-view (BEV) is trending as cameras are cost-effective for mass production in autonomous driving industry. However, there exists a distinct performance gap between multi-camera BEV and LiDAR based 3D object detection. One key reason is that LiDAR captures accurate depth and other geometry measurements, while it is notoriously challenging to infer such 3D information from merely image input. In this work, we propose to boost the representation learning of a multi-camera BEV based student detector by training it to imitate the features of a well-trained LiDAR based teacher detector. We propose effective balancing strategy to enforce the student to focus on learning the crucial features from the teacher, and generalize knowledge transfer to multi-scale layers with temporal fusion. We conduct extensive evaluations on multiple representative models of multi-camera BEV. Experiments reveal that our approach renders significant improvement over the student models, leading to the state-of-the-art performance on the popular benchmark nuScenes.


title: Doduo: Learning Dense Visual Correspondence from Unsupervised Semantic-Aware Flow

abstract: Dense visual correspondence plays a vital role in robotic perception. This work focuses on establishing the dense correspondence between a pair of images that captures dynamic scenes undergoing substantial transformations. We introduce Doduo to learn general dense visual correspondence from in-the-wild images and videos without ground truth supervision. Given a pair of images, it estimates the dense flow field encoding the displacement of each pixel in one image to its corresponding pixel in the other image. Doduo uses flow-based warping to acquire supervisory signals for the training. Incorporating semantic priors with self-supervised flow training, Doduo produces accurate dense correspondence robust to the dynamic changes of the scenes. Trained on an in-the-wild video dataset, Doduo illustrates superior performance on point-level correspondence estimation over existing self-supervised correspondence learning baselines. We also apply Doduo to articulation estimation and zero-shot goal-conditioned manipulation, underlining its practical applications in robotics. Code and additional visualizations are available at https://ut-austin-rpl.github.io/Doduo


title: SGD Finds then Tunes Features in Two-Layer Neural Networks with near-Optimal Sample Complexity: A Case Study in the XOR problem

abstract: In this work, we consider the optimization process of minibatch stochastic gradient descent (SGD) on a 2-layer neural network with data separated by a quadratic ground truth function. We prove that with data drawn from the $d$-dimensional Boolean hypercube labeled by the quadratic ``XOR'' function $y = -x_ix_j$, it is possible to train to a population error $o(1)$ with $d \:\text{polylog}(d)$ samples. Our result considers simultaneously training both layers of the two-layer-neural network with ReLU activations via standard minibatch SGD on the logistic loss. To our knowledge, this work is the first to give a sample complexity of $\tilde{O}(d)$ for efficiently learning the XOR function on isotropic data on a standard neural network with standard training. Our main technique is showing that the network evolves in two phases: a $\textit{signal-finding}$ phase where the network is small and many of the neurons evolve independently to find features, and a $\textit{signal-heavy}$ phase, where SGD maintains and balances the features. We leverage the simultaneous training of the layers to show that it is sufficient for only a small fraction of the neurons to learn features, since those neurons will be amplified by the simultaneous growth of their second layer weights.


title: InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Composition

abstract: We propose InternLM-XComposer, a vision-language large model that enables advanced image-text comprehension and composition. The innovative nature of our model is highlighted by three appealing properties: 1) Interleaved Text-Image Composition: InternLM-XComposer can effortlessly generate coherent and contextual articles that seamlessly integrate images, providing a more engaging and immersive reading experience. Simply provide a writing instruction, and our system will generate the corresponding manuscript. It can intelligently identify the areas in the text where images would enhance the content and automatically insert the most appropriate visual candidates. 2) Comprehension with Rich Multilingual Knowledge: The text-image comprehension is empowered by training on an extensive multi-modal multilingual database with carefully crafted strategies, resulting in a deep understanding of visual content. 3) State-of-the-art Performance: Our model consistently achieves state-of-the-art results across various mainstream benchmarks for vision-language foundational models, including MME Benchmark, MMBench, MMBench-CN, Seed-Bench, CCBench (Chinese Cultural Benchmark), QBench and Tiny LVLM. Owing to the absence of established metrics for quantitatively assessing text-image composition, we have devised a robust evaluation procedure that comprises both human and GPT4-Vision (GPT4-V) to ensure reliability. Notably, our InternLM-XComposer achieves competitive text-image composition scores compared to public solutions, including GPT4-V and GPT3.5. Collectively, InternLM-XComposer seamlessly blends advanced text-image comprehension and composition, revolutionizing vision-language interaction and offering new insights and opportunities. The InternLM-XComposer model series are publicly available at https://github.com/InternLM/InternLM-XComposer.


title: Stable Bosonic Topological Edge Modes in the Presence of Many-Body Interactions

abstract: Many magnetic materials are predicted to exhibit bosonic topological edge modes in their excitation spectra, because of the nontrivial topology of their magnon, triplon or other quasi-particle band structures. However, there is a discrepancy between theory prediction and experimental observation, which suggests some underlying mechanism that intrinsically suppresses the expected experimental signatures, like the thermal Hall current. Many-body interactions that are not accounted for in the non-interacting quasi-particle picture are most often identified as the reason for the absence of the topological edge modes. Here we report stable bosonic edge modes at the boundaries of a ladder quantum paramagnet with gapped triplon excitations in the presence of the full many-body interaction. For the first time, we use tensor network methods to resolve topological edge modes in the time-dependent spin-spin correlations and the dynamical structure factor, which is directly accessible experimentally. We further show that these edge modes have anomalously long time coherence, discuss the topological phase diagram of the model, demonstrate the fractionalization of its low-lying excitations, and propose potential material candidates.


title: Solutions with positive components to quasilinear parabolic systems

abstract: We obtain sufficient conditions for the existence and uniqueness of solutions with non-negative components to general quasilinear parabolic problems \begin{equation*} \partial_t u^k = \sum_{i,j=1}^n a_{ij} (t,x,u)\partial^2_{x_i x_j}\!u^k + \sum_{i=1}^n b_i (t,x,u, \partial_x u) \partial_{x_i} u^k +\, c^k(t,x,u,\partial_x u), \\ u^k(0,x) = \varphi^k(x), \\ u^k(t,\,\cdot\,) = 0, \quad \text{on } \partial \mathbb F, k=1,2, \dots, m, \quad x\in\mathbb F, \;\; t>0. \end{equation*} Here, $\mathbb F$ is either a bounded domain or $\mathbb R^n$; in the latter case, we disregard the boundary condition. We apply our results to study the existence and asymptotic behavior of componentwise non-negative solutions to the Lotka-Volterra competition model with diffusion. In particular, we show the convergence, as $t\to+\infty$, of the solution for a 2-species Lotka-Volterra model, whose coefficients vary in space and time, to a solution of the associated elliptic problem.


title: Planted Random Number Partitioning Problem

abstract: We consider the random number partitioning problem (\texttt{NPP}): given a list $X\sim \mathcal{N}(0,I_n)$ of numbers, find a partition $\sigma\in\{-1,1\}^n$ with a small objective value $H(\sigma)=\frac{1}{\sqrt{n}}\left|\langle \sigma,X\rangle\right|$. The \texttt{NPP} is widely studied in computer science; it is also closely related to the design of randomized controlled trials. In this paper, we propose a planted version of the \texttt{NPP}: fix a $\sigma^*$ and generate $X\sim \mathcal{N}(0,I_n)$ conditional on $H(\sigma^*)\le 3^{-n}$. The \texttt{NPP} and its planted counterpart are statistically distinguishable as the smallest objective value under the former is $\Theta(\sqrt{n}2^{-n})$ w.h.p. Our first focus is on the values of $H(\sigma)$. We show that, perhaps surprisingly, planting does not induce partitions with an objective value substantially smaller than $2^{-n}$: $\min_{\sigma \ne \pm \sigma^*}H(\sigma) = \widetilde{\Theta}(2^{-n})$ w.h.p. Furthermore, we completely characterize the smallest $H(\sigma)$ achieved at any fixed distance from $\sigma^*$. Our second focus is on the algorithmic problem of efficiently finding a partition $\sigma$, not necessarily equal to $\pm\sigma^*$, with a small $H(\sigma)$. We show that planted \texttt{NPP} exhibits an intricate geometrical property known as the multi Overlap Gap Property ($m$-OGP) for values $2^{-\Theta(n)}$. We then leverage the $m$-OGP to show that stable algorithms satisfying a certain anti-concentration property fail to find a $\sigma$ with $H(\sigma)=2^{-\Theta(n)}$. Our results are the first instance of the $m$-OGP being established and leveraged to rule out stable algorithms for a planted model. More importantly, they show that the $m$-OGP framework can also apply to planted models, if the algorithmic goal is to return a solution with a small objective value.


title: A Single Ejection Model of the DART/Dimorphos Debris Trail

abstract: The collision of the NASA DART spacecraft with asteroid Dimorphos resulted in the formation of a distinctive and long-lived debris trail, formed by the action of solar radiation pressure on ejected particles. This trail briefly displayed a double appearance, which has been interpreted as the result of a double ejection. We present a model which can produce a transient double trail without the need to assume a double ejection. Our model explains the appearance of the double trail as a projection of the cone walls when viewed from a large angle to the cone axis and avoids the problem of producing dust in two epochs from a single, instantaneous impact. The particles follow a broken power-law size distribution, with differential indices q = 2.7+/-0.2 (1 um <= a <= 2 mm), 3.9+/-0.1 (2 mm < a <= 1 cm), and 4.2+/-0.2 (1 cm < a <= 20 cm). We find that the total trail mass in particles from 1 um to 20 cm in size (for an assumed density 3500 kg/m3) is ~1.7e7 kg, rising to 2.2e7 kg, when extended to boulders up to 3.5 m in radius. This corresponds to 0.4-0.6% of the mass of Dimorphos.


title: Generating Visual Scenes from Touch

abstract: An emerging line of work has sought to generate plausible imagery from touch. Existing approaches, however, tackle only narrow aspects of the visuo-tactile synthesis problem, and lag significantly behind the quality of cross-modal synthesis methods in other domains. We draw on recent advances in latent diffusion to create a model for synthesizing images from tactile signals (and vice versa) and apply it to a number of visuo-tactile synthesis tasks. Using this model, we significantly outperform prior work on the tactile-driven stylization problem, i.e., manipulating an image to match a touch signal, and we are the first to successfully generate images from touch without additional sources of information about the scene. We also successfully use our model to address two novel synthesis problems: generating images that do not contain the touch sensor or the hand holding it, and estimating an image's shading from its reflectance and touch.


title: Classification of symmetry-enriched topological quantum spin liquids

abstract: We present a systematic framework to classify symmetry-enriched topological quantum spin liquids in two spatial dimensions. This framework can deal with all topological quantum spin liquids, which may be either Abelian or non-Abelian, chiral or non-chiral. It can systematically treat a general symmetry, which may include both lattice symmetry and internal symmetry, may contain anti-unitary symmetry, and may permute anyons. The framework applies to all types of lattices, and can systematically distinguish different lattice systems with the same symmetry group using their Lieb-Schultz-Mattis anomalies. We apply this framework to classify $U(1)_{2N}$ chiral states and non-Abelian Ising$^{(\nu)}$ states enriched by a $p6\times SO(3)$ or $p4\times SO(3)$ symmetry, and $\mathbb{Z}_N$ topological orders and $U(1)_{2N}\times U(1)_{-2N}$ topological orders enriched by a $p6m\times SO(3)\times\mathbb{Z}_2^T$, $p4m\times SO(3)\times\mathbb{Z}_2^T$, $p6m\times\mathbb{Z}_2^T$ or $p4m\times\mathbb{Z}_2^T$ symmetry, where $p6$, $p4$, $p6m$ and $p4m$ are lattice symmetries, while $SO(3)$ and $\mathbb{Z}_2^T$ are spin rotation and time reversal symmetries, respectively. In particular, we identify symmetry-enriched topological quantum spin liquids that are not easily captured by the usual parton-mean-field approach, including examples with the familiar $\mathbb{Z}_2$ topological order.

categories: cond-mat.str-el cond-mat.quant-gas hep-th math-ph math.MP


title: Probing light relics through cosmic dawn

abstract: We explore the prospects of upcoming 21-cm surveys of cosmic dawn ($12\lesssim \!z\lesssim\!30$) to provide cosmological information on top of upcoming cosmic microwave background (CMB) and large-scale structure surveys, such as CMB-S4, Simons Observatory (SO) and DESI. We focus on the effective number of relativistic species $N_{\rm eff}$ which is a promising observable for probing beyond the Standard Model theories. We show including upcoming 21-cm surveys such as the Square Kilometre Array (SKA) can allow probing a wide range of models for light particles at $2\sigma$ level achieving $2\sigma(N_{\rm eff})=0.034$ with CMB-S4, for example. Taking into account the degeneracy between $N_{\rm eff}$ and primordial helium fraction $Y_p$, one can achieve improvements in sensitivities to cosmological parameters, in particular, by more than a factor of 2 for $N_{\rm eff}$ and dark matter fractional energy density $\omega_c$.


title: Decorative coating or corrosion product? TEM and SEM Study on a Late Neolithic Axe to find origins of silver metal on the surface

abstract: Here we report on the analysis of a metallic Late Neolithic copper axe by means of Scanning Electron Microscopy (SEM) and Transmission Electron Microscopy (TEM). The axe was found at Eskilstorp, south-west Scania during archaeological excavations in autumn of 2015. It showed a hint of silver en-richment on the surface which is unusual for Late Neolithic axes from Pile type hoard. To identify the origin of the silver content, we extracted a thin lamella of the axe interior using Focused Ion Beam (FIB) technology to reach the internal structure to keep the process extremely minimally invasive. The results revealed the presence of porous external layer of copper oxide enriched with silver particles. It is shown with the corrosion test performed on copper-silver experimental replica that the silver en-richment is attributed to the selective dissolution of copper metal as a resut of corrosion process on the axe. The corrosion experiment is performed in the presence of an organic electrolyte such as Hemic Acid (HA) which replicates soil and natural water environment. In the scope of this research work, we found a strong evidence that the silver on the surface of the axe was not decrative layer and instead remained on the surface due to its more noble character while copper leached out into the soil due to corrosion.


title: Thermal Conductivity Measurement Using Modulated Photothermal Radiometry for Nitrate and Chloride Molten Salts

abstract: Molten salts are being used or explored for thermal energy storage and conversion systems in concentrating solar power and nuclear power plants. Thermal conductivity of molten salts is an important thermophysical property dictating the performance and cost of these systems, but its accurate measurement has been challenging, as evidenced by wide scattering of existing data in literature. The corrosive and conducting nature of these fluids also leads to time consuming sample preparation processes of many contact-based measurements. Here, we report the measurement of thermal conductivity of molten salts using a modulated photothermal radiometry (MPR) technique, which is a laser-based, non-contact, frequency-domain method adopted for molten salts for the first time. By unitizing the advantages of front side sensing of frequency-domain measurements and the vertical holder orientation, the technique can minimize the natural convection and salt creeping effects, thus yielding accurate molten salt thermal conductivity. The MPR technique is first calibrated using standard molten materials including paraffin wax and sulfur. It is then applied on measuring pure nitrate salts ($NaNO_3$ and $KNO_3$), solar salt ($NaNO_3-KNO_3$ mixture), and chloride salt ($NaCl-KCl-MgCl_2$). The measurement results are compared with data from literature, especially those obtained from laser flash analysis (LFA). Our results demonstrate that the MPR is a convenient and reliable technique of measuring thermal conductivity of molten salts. Accurate thermal conductivity data of molten salts will be valuable in developing the next-generation high-temperature thermal energy storage and conversion systems.


title: Differential cross section for elastic collision, first exited state and ionization of water molecule

abstract: The radiolysis of water is an important study in microdosimetry, one of the resulting and important molecules in this study is the $OH^-$. Theoretical quantum mechanics calculations are used to obtain the differential cross section for the elastic collision, first excited state and ionization of water molecule. For the ionization case, obtaining $OH^-$ is studied. As incident particles are considered electrons and protons, independently for each phenomena previously mentioned. The differential cross section was obtained by the amplitude function. The water molecule model used to calculations consisted by the two protons of the hydrogen atom that make up the water molecule and the structure-less and doubly charged oxygen. For the proton incident particle case, the identical particle analysis was used. The results show the angular dependence and therefore the interference phenomenon between the incident wave and the deflected wave


title: Uncovering Neural Scaling Laws in Molecular Representation Learning

abstract: Molecular Representation Learning (MRL) has emerged as a powerful tool for drug and materials discovery in a variety of tasks such as virtual screening and inverse design. While there has been a surge of interest in advancing model-centric techniques, the influence of both data quantity and quality on molecular representations is not yet clearly understood within this field. In this paper, we delve into the neural scaling behaviors of MRL from a data-centric viewpoint, examining four key dimensions: (1) data modalities, (2) dataset splitting, (3) the role of pre-training, and (4) model capacity. Our empirical studies confirm a consistent power-law relationship between data volume and MRL performance across these dimensions. Additionally, through detailed analysis, we identify potential avenues for improving learning efficiency. To challenge these scaling laws, we adapt seven popular data pruning strategies to molecular data and benchmark their performance. Our findings underline the importance of data-centric MRL and highlight possible directions for future research.


title: Mechanical and Acoustic Studies of Deep Ocean Glass Sphere Implosions

abstract: The recent likely implosion of the Titan deep ocean submersible's spherical pressure hull has elevated interest and concerns on the nature and dynamics of such events. Here we report on studies of three deep-ocean implosions of 43 cm diameter glass instrument housings, made by Benthos Inc. The goal of the studies was to determine the effects on their associated cabling, moorings, and other spheres as part of a larger deep sea observatory. High resolution acoustic profiles were also measured for two of the three implosions, allowing us to infer some of the dynamics and kinematics of the events. The mechanical forces on the ancillary mooring hardware during the entire implosive/explosive event were found to be most probably dominated by the explosive shock wave following the initial infall. A syntactic float at a distance of 16 m from the implosion center was probably shattered by such a shock wave, but 3 glass instrument housings apparently survived within a distance of 6 m from the same implosion.


title: Simulating Radiation Shielding Effectiveness Against Three Neutron Sources

abstract: Laboratories and Universities regularly apply for approval from the United States Nuclear Regulatory Commission (NRC) to use neutron generators for experimental research. To comply with the regulations set by the NRC, adequate shielding is necessary to ensure that the radiation dose rates experienced by an operator, and outside the walls of any containment buildings, are below the prescribed levels. Typically, the neutron source needs to be shielded such that the radiation dose rate experienced by any user is less than 0.25 mRem/hr (500mrem/2000-hour work-year). To address this requirement, we investigate the effectiveness of boronated concrete, boronated water, and light water shielding materials and their applicability to three neutron sources. We present our findings on the radiation shielding design and calculations for three neutron sources situated inside shielding layers. Our modeling utilized the Monte Carlo n-Particle transport codes (MCNP6.2) to simulate neutron attenuation of the shielding. The simulation results reveal that a light water shielding can sufficiently reduce the dose rate for an individual located as close as two meters from the source. Therefore, this shield design can effectively decrease the radiation dose below the maximum recommended limit.


title: From Peptides to Nanostructures: A Euclidean Transformer for Fast and Stable Machine Learned Force Fields

abstract: Recent years have seen vast progress in the development of machine learned force fields (MLFFs) based on ab-initio reference calculations. Despite achieving low test errors, the reliability of MLFFs in molecular dynamics (MD) simulations is facing growing scrutiny due to concerns about instability over extended simulation timescales. Our findings suggest a potential connection between robustness to cumulative inaccuracies and the use of equivariant representations in MLFFs, but the computational cost associated with these representations can limit this advantage in practice. To address this, we propose a transformer architecture called SO3krates that combines sparse equivariant representations (Euclidean variables) with a self-attention mechanism that separates invariant and equivariant information, eliminating the need for expensive tensor products. SO3krates achieves a unique combination of accuracy, stability, and speed that enables insightful analysis of quantum properties of matter on extended time and system size scales. To showcase this capability, we generate stable MD trajectories for flexible peptides and supra-molecular structures with hundreds of atoms. Furthermore, we investigate the PES topology for medium-sized chainlike molecules (e.g., small peptides) by exploring thousands of minima. Remarkably, SO3krates demonstrates the ability to strike a balance between the conflicting demands of stability and the emergence of new minimum-energy conformations beyond the training data, which is crucial for realistic exploration tasks in the field of biochemistry.


title: Grad DFT: a software library for machine learning enhanced density functional theory

abstract: Density functional theory (DFT) stands as a cornerstone method in computational quantum chemistry and materials science due to its remarkable versatility and scalability. Yet, it suffers from limitations in accuracy, particularly when dealing with strongly correlated systems. To address these shortcomings, recent work has begun to explore how machine learning can expand the capabilities of DFT; an endeavor with many open questions and technical challenges. In this work, we present Grad DFT: a fully differentiable JAX-based DFT library, enabling quick prototyping and experimentation with machine learning-enhanced exchange-correlation energy functionals. Grad DFT employs a pioneering parametrization of exchange-correlation functionals constructed using a weighted sum of energy densities, where the weights are determined using neural networks. Moreover, Grad DFT encompasses a comprehensive suite of auxiliary functions, notably featuring a just-in-time compilable and fully differentiable self-consistent iterative procedure. To support training and benchmarking efforts, we additionally compile a curated dataset of experimental dissociation energies of dimers, half of which contain transition metal atoms characterized by strong electronic correlations. The software library is tested against experimental results to study the generalization capabilities of a neural functional across potential energy surfaces and atomic species, as well as the effect of training data noise on the resulting model accuracy.

categories: physics.chem-ph cond-mat.mtrl-sci cs.LG quant-ph


title: DPA-WNO: A gray box model for a class of stochastic mechanics problem

abstract: The well-known governing physics in science and engineering is often based on certain assumptions and approximations. Therefore, analyses and designs carried out based on these equations are also approximate. The emergence of data-driven models has, to a certain degree, addressed this challenge; however, the purely data-driven models often (a) lack interpretability, (b) are data-hungry, and (c) do not generalize beyond the training window. Operator learning has recently been proposed as a potential alternative to address the aforementioned challenges; however, the challenges are still persistent. We here argue that one of the possible solutions resides in data-physics fusion, where the data-driven model is used to correct/identify the missing physics. To that end, we propose a novel Differentiable Physics Augmented Wavelet Neural Operator (DPA-WNO). The proposed DPA-WNO blends a differentiable physics solver with the Wavelet Neural Operator (WNO), where the role of WNO is to model the missing physics. This empowers the proposed framework to exploit the capability of WNO to learn from data while retaining the interpretability and generalizability associated with physics-based solvers. We illustrate the applicability of the proposed approach in solving time-dependent uncertainty quantification problems due to randomness in the initial condition. Four benchmark uncertainty quantification and reliability analysis examples from various fields of science and engineering are solved using the proposed approach. The results presented illustrate interesting features of the proposed approach.


title: Evaluating Cognitive Maps and Planning in Large Language Models with CogEval

abstract: Recently an influx of studies claim emergent cognitive abilities in large language models (LLMs). Yet, most rely on anecdotes, overlook contamination of training sets, or lack systematic Evaluation involving multiple tasks, control conditions, multiple iterations, and statistical robustness tests. Here we make two major contributions. First, we propose CogEval, a cognitive science-inspired protocol for the systematic evaluation of cognitive capacities in Large Language Models. The CogEval protocol can be followed for the evaluation of various abilities. Second, here we follow CogEval to systematically evaluate cognitive maps and planning ability across eight LLMs (OpenAI GPT-4, GPT-3.5-turbo-175B, davinci-003-175B, Google Bard, Cohere-xlarge-52.4B, Anthropic Claude-1-52B, LLaMA-13B, and Alpaca-7B). We base our task prompts on human experiments, which offer both established construct validity for evaluating planning, and are absent from LLM training sets. We find that, while LLMs show apparent competence in a few planning tasks with simpler structures, systematic evaluation reveals striking failure modes in planning tasks, including hallucinations of invalid trajectories and getting trapped in loops. These findings do not support the idea of emergent out-of-the-box planning ability in LLMs. This could be because LLMs do not understand the latent relational structures underlying planning problems, known as cognitive maps, and fail at unrolling goal-directed trajectories based on the underlying structure. Implications for application and future directions are discussed.


title: Understanding the Structure of QM7b and QM9 Quantum Mechanical Datasets Using Unsupervised Learning

abstract: This paper explores the internal structure of two quantum mechanics datasets (QM7b, QM9), composed of several thousands of organic molecules and described in terms of electronic properties. Understanding the structure and characteristics of this kind of data is important when predicting the atomic composition from the properties in inverse molecular designs. Intrinsic dimension analysis, clustering, and outlier detection methods were used in the study. They revealed that for both datasets the intrinsic dimensionality is several times smaller than the descriptive dimensions. The QM7b data is composed of well defined clusters related to atomic composition. The QM9 data consists of an outer region predominantly composed of outliers, and an inner core region that concentrates clustered, inliner objects. A significant relationship exists between the number of atoms in the molecule and its outlier/inner nature. Despite the structural differences, the predictability of variables of interest for inverse molecular design is high. This is exemplified with models estimating the number of atoms of the molecule from both the original properties, and from lower dimensional embedding spaces.


title: Combining optical diffraction tomography with imaging flow cytometry for characterizing morphology, hemoglobin content, and membrane deformability of live red blood cells

abstract: Integrating optical diffraction tomography with imaging flow cytometry enables label-free quantifications of the three-dimensional (3D) morphology and hemoglobin content of red blood cells (RBCs) in their natural form. Self-rotation of RBCs flowing in a microfluidic channel has been utilized to achieve various projection directions for 3D reconstruction. However, the practicality of this technique has not been sufficiently studied. We improved the accuracy of estimating the rotation angle of RBCs and demonstrated 3D reconstructions of both healthy and glutaraldehyde-treated RBCs. Results showed the capability to quantify changes in RBC morphology, hemoglobin content, and membrane fluctuations generated by glutaraldehyde treatments, demonstrating the potential to detect changes frequently present in various RBC membrane disorders.


title: Genetic InfoMax: Exploring Mutual Information Maximization in High-Dimensional Imaging Genetics Studies

abstract: Genome-wide association studies (GWAS) are used to identify relationships between genetic variations and specific traits. When applied to high-dimensional medical imaging data, a key step is to extract lower-dimensional, yet informative representations of the data as traits. Representation learning for imaging genetics is largely under-explored due to the unique challenges posed by GWAS in comparison to typical visual representation learning. In this study, we tackle this problem from the mutual information (MI) perspective by identifying key limitations of existing methods. We introduce a trans-modal learning framework Genetic InfoMax (GIM), including a regularized MI estimator and a novel genetics-informed transformer to address the specific challenges of GWAS. We evaluate GIM on human brain 3D MRI data and establish standardized evaluation protocols to compare it to existing approaches. Our results demonstrate the effectiveness of GIM and a significantly improved performance on GWAS.


title: From Asset Flow to Status, Action and Intention Discovery: Early Malice Detection in Cryptocurrency

abstract: Cryptocurrency has been subject to illicit activities probably more often than traditional financial assets due to the pseudo-anonymous nature of its transacting entities. An ideal detection model is expected to achieve all three critical properties of (I) early detection, (II) good interpretability, and (III) versatility for various illicit activities. However, existing solutions cannot meet all these requirements, as most of them heavily rely on deep learning without interpretability and are only available for retrospective analysis of a specific illicit type. To tackle all these challenges, we propose Intention-Monitor for early malice detection in Bitcoin (BTC), where the on-chain record data for a certain address are much scarcer than other cryptocurrency platforms. We first define asset transfer paths with the Decision-Tree based feature Selection and Complement (DT-SC) to build different feature sets for different malice types. Then, the Status/Action Proposal Module (S/A-PM) and the Intention-VAE module generate the status, action, intent-snippet, and hidden intent-snippet embedding. With all these modules, our model is highly interpretable and can detect various illegal activities. Moreover, well-designed loss functions further enhance the prediction speed and model's interpretability. Extensive experiments on three real-world datasets demonstrate that our proposed algorithm outperforms the state-of-the-art methods. Furthermore, additional case studies justify our model can not only explain existing illicit patterns but can also find new suspicious characters.


title: A general method to reconstruct strong gravitational lenses based on the singular perturbative approach

abstract: The number of gravitational arcs systems detected is increasing quickly and should even increase at a faster rate in the near future. This wealth of new gravitational arcs requires the development of a purely automated method to reconstruct the lens and source. A general reconstruction method based on the singular perturbative approach is proposed in this paper. This method generates a lens and source reconstruction directly from the gravitational arc image. The method is fully automated and works in two steps. The first step is to generate a guess solution based on the circular solution in the singular perturbative approach. The second step is to break the sign degeneracy and to refine the solution by using a general source model. The refinement of the solution is conducted step by step to avoid the source-lens degeneracy issue. One important asset of this automated method is that the lens solution is written in universal terms which allows the computation of statistics. Considering the large number of lenses which should be available in the near future this ability to compute un-biased statistics is an important asset.


abstract: Multi-view clustering thrives in applications where views are collected in advance by extracting consistent and complementary information among views. However, it overlooks scenarios where data views are collected sequentially, i.e., real-time data. Due to privacy issues or memory burden, previous views are not available with time in these situations. Some methods are proposed to handle it but are trapped in a stability-plasticity dilemma. In specific, these methods undergo a catastrophic forgetting of prior knowledge when a new view is attained. Such a catastrophic forgetting problem (CFP) would cause the consistent and complementary information hard to get and affect the clustering performance. To tackle this, we propose a novel method termed Contrastive Continual Multi-view Clustering with Filtered Structural Fusion (CCMVC-FSF). Precisely, considering that data correlations play a vital role in clustering and prior knowledge ought to guide the clustering process of a new view, we develop a data buffer with fixed size to store filtered structural information and utilize it to guide the generation of a robust partition matrix via contrastive learning. Furthermore, we theoretically connect CCMVC-FSF with semi-supervised learning and knowledge distillation. Extensive experiments exhibit the excellence of the proposed method.


title: A multi-modal approach for identifying schizophrenia using cross-modal attention

abstract: This study focuses on how different modalities of human communication can be used to distinguish between healthy controls and subjects with schizophrenia who exhibit strong positive symptoms. We developed a multi-modal schizophrenia classification system using audio, video, and text. Facial action units and vocal tract variables were extracted as low-level features from video and audio respectively, which were then used to compute high-level coordination features that served as the inputs to the audio and video modalities. Context-independent text embeddings extracted from transcriptions of speech were used as the input for the text modality. The multi-modal system is developed by fusing a segment-to-session-level classifier for video and audio modalities with a text model based on a Hierarchical Attention Network (HAN) with cross-modal attention. The proposed multi-modal system outperforms the previous state-of-the-art multi-modal system by 8.53% in the weighted average F1 score.


title: Deep Generative Methods for Producing Forecast Trajectories in Power Systems

abstract: With the expansion of renewables in the electricity mix, power grid variability will increase, hence a need to robustify the system to guarantee its security. Therefore, Transport System Operators (TSOs) must conduct analyses to simulate the future functioning of power systems. Then, these simulations are used as inputs in decision-making processes. In this context, we investigate using deep learning models to generate energy production and load forecast trajectories. To capture the spatiotemporal correlations in these multivariate time series, we adapt autoregressive networks and normalizing flows, demonstrating their effectiveness against the current copula-based statistical approach. We conduct extensive experiments on the French TSO RTE wind forecast data and compare the different models with \textit{ad hoc} evaluation metrics for time series generation.


title: Quasilocal Corrections to Bondi's Mass-Loss Formula and Dynamical Horizons

abstract: In this work, a null geometric approach to the Brown-York quasilocal formalism is used to derive an integral law that describes the rate of change of mass and/or radiative energy escaping through a dynamical horizon of a non-stationary spacetime. The result thus obtained shows - in accordance with previous results from the theory of dynamical horizons of Ashtekar et al. - that the rate at which energy is transferred from the bulk to the boundary of spacetime through the dynamical horizon becomes zero at equilibrium, where said horizon becomes non-expanding and null. Moreover, it reveals previously unrecognized quasilocal corrections to the Bondi mass-loss formula arising from the combined variation of bulk and boundary components of the Brown-York Hamiltonian, given in terms of a bulk-to-boundary inflow term akin to an expression derived in an earlier paper by the author [#huber2022remark]. For clarity, this is discussed with reference to the Generalized Vaidya family of spacetimes, for which derived integral expressions take a particularly simple form.


title: PINF: Continuous Normalizing Flows for Physics-Constrained Deep Learning

abstract: The normalization constraint on probability density poses a significant challenge for solving the Fokker-Planck equation. Normalizing Flow, an invertible generative model leverages the change of variables formula to ensure probability density conservation and enable the learning of complex data distributions. In this paper, we introduce Physics-Informed Normalizing Flows (PINF), a novel extension of continuous normalizing flows, incorporating diffusion through the method of characteristics. Our method, which is mesh-free and causality-free, can efficiently solve high dimensional time-dependent and steady-state Fokker-Planck equations.


title: A Review on AI Algorithms for Energy Management in E-Mobility Services

abstract: E-mobility, or electric mobility, has emerged as a pivotal solution to address pressing environmental and sustainability concerns in the transportation sector. The depletion of fossil fuels, escalating greenhouse gas emissions, and the imperative to combat climate change underscore the significance of transitioning to electric vehicles (EVs). This paper seeks to explore the potential of artificial intelligence (AI) in addressing various challenges related to effective energy management in e-mobility systems (EMS). These challenges encompass critical factors such as range anxiety, charge rate optimization, and the longevity of energy storage in EVs. By analyzing existing literature, we delve into the role that AI can play in tackling these challenges and enabling efficient energy management in EMS. Our objectives are twofold: to provide an overview of the current state-of-the-art in this research domain and propose effective avenues for future investigations. Through this analysis, we aim to contribute to the advancement of sustainable and efficient e-mobility solutions, shaping a greener and more sustainable future for transportation.


title: Anisotropic Energy Injection from Magnetar Central Engines in Short GRBs

abstract: A long-lived magnetar, potentially originating from a binary neutron star system, has been proposed to explain the extended emission observed in certain short-duration gamma-ray bursts (sGRBs), and is posited as a potential central engine to power the engine-fed kilonovae. Previously, the process by which energy is injected into the surrounding ejecta/jet was widely believed to be nearly isotropic. In this study, we employ special relativity magnetohydrodynamic (SRMHD) simulations to investigate the wind injection process from a magnetar central engine. We explore the dynamics and energy distribution within the system and found that the parameter $\alpha=u_{\rm A}/u_{\rm MWN}$ can be used to indicate the collimation of the magnetar wind energy injection, where $u_{\rm A}$ is the local Alfven four-speed and $u_{\rm MWN}$ is the four-speed of the magnetar wind nebular (MWN) formed from wind-ejecta collision. A significant portion of the injected energy from the magnetar spin-down wind will be channeled to the jet axis due to collimation within the MWN. Achieving isotropic energy injection requires a significantly small $\alpha$ that necessitates either an ultra-relativistic expanding MWN or an extremely low magnetization MWN, both of which are challenging to attain in sGRBs. Consequently, a considerably reduced energy budget (i.e. energy per solid angle reduced by a factor of up to 10 with respect to the value under isotropic assumption) is anticipated to be injected into the ejecta for engine-fed kilonovae. Engine-fed kilonovae would appear fainter than originally anticipated.


title: Active actions: effective field theory for active nematics

abstract: Active matter consumes energy from the environment and transforms it into mechanical work. Notable examples from biology include cell division, bacterial swarms, and muscle contraction. In this work, we investigate the nature of active matter systems using the powerful effective field theory toolbox. This allows us to construct the most general theory without ambiguity up to a given order in the derivative expansion. Our primary focus is active nematics -- liquid crystal systems that spontaneously break rotational but not translational symmetry -- in two spatial dimensions. (Such spontaneous symmetry breaking is allowed if the nematic is embedded in a higher dimensional space.) While we focus on this one particular class of physical system, the tools developed here can in principle be applied to any active matter system. Our theories give unambiguous predictions for the relationship between fluctuations and equations of motion in the presence of activity, generalizing the standard fluctuation-dissipation relations characteristic of passive systems.

categories: cond-mat.soft physics.app-ph physics.bio-ph physics.chem-ph


title: Triage of the Gaia DR3 astrometric orbits. II. A census of white dwarfs

abstract: The third data release of Gaia was the first to include orbital solutions assuming non-single stars. Here, we apply the astrometric triage technique of Shahaf et al. to identify binary star systems with companions that are not single main-sequence stars. Gaia's synthetic photometry of these binaries is used to distinguish between systems likely to have white-dwarf companions and those that may be hierarchical triples. The study uncovered a population of nearly 3200 binaries, characterised by orbital separations on the order of an astronomical unit, in which the faint astrometric companion is probably a white dwarf. This sample increases the number of orbitally solved binary systems of this type by about two orders of magnitude. Remarkably, over 110 of these systems exhibit significant ultraviolet excess flux, confirming this classification and, in some cases, indicating their relatively young cooling ages. We show that the sample is not currently represented in synthetic binary populations, and is not easily reproduced by available binary population synthesis codes. Therefore, it challenges current binary evolution models, offering a unique opportunity to gain insights into the processes governing white-dwarf formation, binary evolution, and mass transfer.


title: 3D tomography of the giant Ly$\alpha$ nebulae of $z$$\approx$3--5 radio-loud AGN

abstract: Ly$\alpha$ emission nebulae are ubiquitous around high-z galaxies and are tracers of the gaseous environment on scales out to >100 kpc. High-z radio galaxies (HzRGs, type-2 radio-loud quasars) host large scale nebulae observed in the ionised gas differ from those seen in other types of high-z quasars. In this work, we exploit MUSE observations of Lya nebulae around eight HzRGs ($2.9<z<4.5$). All the HzRGs have large scale Lya emission nebulae with seven of them extended over 100 kpc at the observed surface brightness (SB) limit. Because the emission line profiles are significantly affected by neutral hydrogen absorbers across the entire nebulae, we perform an absorption correction to infer maps of the intrinsic Lya SB, central velocity and velocity width, all at the last scattering surface of the observed Lya photons. We find: (i) The intrinsic SB radial profiles can be described by an inner exponential and an outter power law; (ii) our HzRGs have higher SB and more asymmetric nebulae than both RL and RQ type-1s; (iii) intrinsic nebula kinematics of four HzRGs show evidence of jet-driven outflows but no general trends for the whole sample; (iv) a relation between the nebula maximum extent and the offset between the AGN and the nebula centroids; (v) an alignment between radio jet position angles and the nebula morphology. All support a scenario where the orientation of the AGN has an impact on the observed nebular morphologies and resonant scattering may affect the shape of the SB profiles, nebular kinematics and relations between the observed Lya morphologies. Furthermore, we find evidence showing that the outskirts of the ionised gas nebulae may be 'contaminated' by Lya photons from nearby emission halos. Overall, this work provides results which allow us to compare Lya nebulae around various classes of quasars at and beyond Cosmic Noon. [Abridged]


title: Holographic Entropy Inequalities and the Topology of Entanglement Wedge Nesting

abstract: We prove two new infinite families of holographic entropy inequalities. A key tool is a graphical arrangement of terms of inequalities, which is based on entanglement wedge nesting (EWN). It associates the inequalities with tessellations of the torus and the projective plane, which reflect a certain topological aspect of EWN. The inequalities prove a prior conjecture about the structure of the holographic entropy cone and show an interesting interplay with differential entropy.


title: Gravitational Production of Spin-3/2 Particles During Reheating

abstract: We compute the density of a spin-$\frac32$ particle, the raritron, produced at the end of inflation due to gravitational interactions. We consider a background inflaton condensate as the source of this production, mediated by the exchange of a graviton. This production greatly exceeds the gravitational production from the emergent thermal bath during reheating. The relic abundance limit sets an absolute minimum mass for a stable raritron, though there are also model dependent constraints imposed by unitarity. We also examine the case of gravitational production of a gravitino, taking into account the goldstino evolution during reheating. We compare these results with conventional gravitino production mechanisms.


title: The OGLE Collection of Variable Stars. Over 15 000 Delta Scuti Stars in the Large Magellanic Cloud

abstract: We present the OGLE collection of delta Scuti stars in the Large Magellanic Cloud and in its foreground. Our dataset encompasses a total of 15 256 objects, constituting the largest sample of extragalactic delta Sct stars published so far. In the case of 12 delta Sct pulsators, we detected additional eclipsing or ellipsoidal variations in their light curves. These are the first known candidates for binary systems containing delta Sct components beyond the Milky Way. We provide observational parameters for all variables, including pulsation periods, mean magnitudes, amplitudes, and Fourier coefficients, as well as long-term light curves in the I- and V-bands collected during the fourth phase of the OGLE project. We construct the period-luminosity (PL) diagram, in which fundamental-mode and first-overtone delta Sct stars form two nearly parallel ridges. The latter ridge is an extension of the PL relation obeyed by first-overtone classical Cepheids. The slopes of the PL relations for delta Sct variables are steeper than those for classical Cepheids, indicating that the continuous PL relation for first-overtone delta Sct variables and Cepheids is non-linear, exhibiting a break at a period of approximately 0.5 d. We also report the enhancement of the OGLE collection of Cepheids and RR Lyr stars with newly identified and reclassified objects, including pulsators contained in the recently published Gaia DR3 catalog of variable stars. As a by-product, we estimate the contamination rate in the Gaia DR3 catalogs of Cepheids and RR Lyr variables.


title: The star formation histories of quiescent ultra-diffuse galaxies and their dependence on environment and globular cluster richness

abstract: We derive the stellar population parameters of 11 quiescent ultra-diffuse galaxies (UDGs) from Keck/KCWI data. We supplement these with 14 literature UDGs, creating the largest spectroscopic sample of UDGs to date (25). We find a strong relationship between their $\alpha$-enhancement and their star formation histories: UDGs that formed on very short timescales have elevated [Mg/Fe] abundance ratios, whereas those forming over extended periods present lower values. Those forming earlier and faster are overall found in high-density environments, being mostly early infalls into the cluster. No other strong trends are found with infall times. We analyze the stellar mass-metallicity, age-metallicity and [Mg/Fe]-metallicity relations of the UDGs, comparing them to other types of low mass galaxies. Overall, UDGs scatter around the established stellar mass--metallicity relations of classical dwarfs. We find that GC-rich UDGs have intermediate-to-old ages, but previously reported trends of galaxy metallicity and GC richness are not reproduced with this spectroscopic sample due to the existence of GC-rich UDGs with elevated metallicities. In addition, we also find that a small fraction of UDGs could be 'failed-galaxies', supported by their GC richness, high $\alpha$-abundances, fast formation timescales and that they follow the mass-metallicity relation of z~2 galaxies. Finally, we also compare our observations to simulated UDGs. We caution that there is not a single simulation that can produce the diverse UDG properties simultaneously, in particular the low metallicity failed-galaxy like UDGs.


title: Bounding the QCD Equation of State with the Lattice

abstract: The equation of state of QCD matter at high densities is relevant for neutron star structure and for neutron star mergers and has been a focus of recent work. We show how lattice QCD simulations, free of sign problems, can provide an upper bound on the pressure as a function of quark chemical potentials. We show that at large chemical potentials this bound should become quite sharp; the difference between the upper bound on the pressure P-phase-quenched and the true pressure P is of order alpha^3 P. The corrections arise from a single Feynman diagram; its calculation would render remaining corrections of order alpha^4 P.


title: A$^3$COSMOS: the infrared luminosity function and dust-obscured star formation rate density at $0.5<z<6$

abstract: Aims: We leverage the largest available Atacama Large Millimetre/submillimetre Array (ALMA) survey from the archive (A$^3$COSMOS) to study to study infrared luminosity function and dust-obscured star formation rate density of sub-millimeter/millimeter (sub-mm/mm) galaxies from $z=0.5\,-\,6$. Methods: The A$^3$COSMOS survey utilizes all publicly available ALMA data in the COSMOS field, therefore having inhomogeneous coverage in terms of observing wavelength and depth. In order to derive the luminosity functions and star formation rate densities, we apply a newly developed method that corrects the statistics of an inhomogeously sampled survey of individual pointings to those representing an unbiased blind survey. Results: We find our sample to mostly consist of massive ($M_{\star} \sim 10^{10} - 10^{12}$ $\rm M_{\odot}$), IR-bright ($L_* \sim 10^{11}-10^{13.5} \rm L_{\odot}$), highly star-forming (SFR $\sim 100-1000$ $\rm M_{\odot}$ $\rm yr^{-1}$) galaxies. We find an evolutionary trend in the typical density ($\Phi^*$) and luminosity ($L^*$) of the galaxy population, which decrease and increase with redshift, respectively. Our IR LF is in agreement with previous literature results and we are able to extend to high redshift ($z > 3$) the constraints on the knee and bright-end of the LF, derived by using the Herschel data. Finally, we obtain the SFRD up to $z\sim 6$ by integrating the IR LF, finding a broad peak from $z \sim 1$ to $z \sim 3$ and a decline towards higher redshifts, in agreement with recent IR/mm-based studies, within the uncertainties, thus implying the presence of larger quantities of dust than what is expected by optical/UV studies.


title: Small-scale signatures of primordial non-Gaussianity in k-Nearest Neighbour cumulative distribution functions

abstract: Searches for primordial non-Gaussianity in cosmological perturbations are a key means of revealing novel primordial physics. However, robustly extracting signatures of primordial non-Gaussianity from non-linear scales of the late-time Universe is an open problem. In this paper, we apply k-Nearest Neighbor cumulative distribution functions, kNN-CDFs, to the \textsc{quijote-png} simulations to explore the sensitivity of kNN-CDFs to primordial non-Gaussianity. An interesting result is that for halo samples with $M_h<10^{14}$ M$_\odot$/h, the kNN-CDFs respond to \textit{equilateral} PNG in a manner distinct from the other parameters. This persists in the galaxy catalogs in redshift space and can be differentiated from the impact of galaxy modelling, at least within the halo occupation distribution (HOD) framework considered here. kNN-CDFs are related to counts-in-cells and, through mapping a subset of the kNN-CDF measurements into the count-in-cells picture, we show that our results can be modeled analytically. A caveat of the analysis is that we only consider the HOD framework, including assembly bias. It will be interesting to validate these results with other techniques for modeling the galaxy--halo connection, e.g., (hybrid) effective field theory or semi-analytical methods.


title: On the String Landscape Without Hypermultiplets

abstract: In this work we study interesting corners of the quantum gravity landscape with 8 supercharges pushing the boundaries of our current understanding. Calabi-Yau threefolds compactifications of F/M/type II theories to 6, 5 and 4 dimensions are the most prominent examples of this class, and these always lead to a universal hypermultiplet coming from the volume/string coupling constant. We find that there are asymmetric orbifold constructions which have no hypermultiplets in 4 or 5 dimensions and no neutral hypers in 6d. We argue that these theories can also be obtained by going to strong coupling/small volume regions of geometric constructions where a new Coulomb branch opens up and moving in this direction freezes the volume/string coupling constant. Interestingly we find that the Kodaira condition encountered in geometric limits of F-theory compactifications to 6 dimensions is violated in these corners of the landscape due to strong quantum corrections. We also construct a theory in 3 dimensions which if it were to arise by toroidal compactifications from 5d, it would have to come from pure ${\mathcal N}=1$ supergravity with no massless scalar fields.


title: Kinetic Ferromagnetism and Topological Magnons of the Hole-Doped Kitaev Spin Liquid

abstract: We study the effect of hole doping on the Kitaev spin liquid (KSL) and find that for ferromagnetic (FM) Kitaev exchange $K$ the system is very susceptible to the formation of a FM spin polarization. Through density matrix renormalization group (DMRG) simulations on finite systems, we uncover that the introduction of a single hole with a hopping strength of just $t\sim{}0.28K$ is enough to disrupt fractionalization and polarize the spins in the [001] direction due to an order-by-disorder mechanism. Taking into account a material relevant FM anisotropic spin exchange $\varGamma$ drives the polarization towards the [111] direction via a reorientation transition into a topological FM state with chiral magnon excitations. We develop a parton mean-field theory incorporating fermionic holons and bosonic spinons/magnons, which accounts for the doping induced FM phases and topological magnon excitations. We discuss experimental signatures and implications for Kitaev candidate materials.


title: Anomalous Linear and Quadratic Nodeless Surface Dirac Cones in Three-Dimensional Dirac Semimetals

abstract: Surface Dirac cones in three-dimensional topological insulators have generated tremendous and enduring interest for almost two decades owing to hosting a multitude of exotic properties. In this work, we unveil the existence of two types of anomalous surface Dirac cones in three-dimensional Dirac semimetals. These surface Dirac cones are located at the surfaces perpendicular to the rotation symmetry axis, and are found to display a number of features remarkably different from that in topological insulators. The most prominent one is the absence of singular Dirac node. In addition, the spin textures of these nodeless surface Dirac cones are found to exhibit a unique two-phase-angle dependence, leading to the presence of two different winding numbers in the orbital-resolved spin textures, which is rather different from the well-known spin-momentum locking in topological insulators. Despite the absence of Dirac node, we find that the two types of surface Dirac cones are also characterized by quantized $\pi$ Berry phases, even though one of them takes a quadratic dispersion. In the presence of time-reversal-symmetry-breaking fields, we find that the responses of the surface and bulk Dirac cones display an interesting bulk-surface correspondence. The uncovering of these nodeless surface Dirac cones broadens our understanding of the topological surface states and bulk-boundary correspondence in Dirac semimetals, and also lays down the basis for studying unconventional Dirac physics.

categories: cond-mat.mtrl-sci cond-mat.mes-hall cond-mat.str-el quant-ph