title: Thermodynamics with conformal Killing vector in the charged Vaidya metric

abstract: We investigate the charged Vaidya spacetime with conformal symmetry by classifying the horizons and finding its connection to Hawking temperature. We find a conformal Killing vector whose existence requires the mass and electric charge functions to be proportional, as well as linear in time. Solving the Killing equations for the conformally transformed metric from the linear charged Vaidya metric yields the required form of the conformal factor. From the vanishing of the norm of the conformal Killing vector, we find three conformal Killing horizons which, under the transformation, are mapped to the Killing horizons of the associated static spacetime, if the spherical symmetry is maintained. We find that the conformal factor is not uniquely determined, but can take any function of the ratio of the radial coordinate to the dynamical mass. As an example, we illustrate a static spacetime with our choice of the conformal factor and explicitly show that the surface gravity of the conformal Killing horizons, which is conformally invariant, yield the expected Hawking temperature in the static spacetime. This static black hole spacetime contains a cosmological horizon, but it is not asymptotically de Sitter. We also investigate the case when the mass parameter is equal to the constant electric charge. While in this case the standard pair of horizons, the loci of the time component of the metric, degenerate, the conformal Killing horizons do not degenerate. This therefore leads to a non-zero Hawking temperature in the associated static spacetime.


title: IFAST: Weakly Supervised Interpretable Face Anti-spoofing from Single-shot Binocular NIR Images

abstract: Single-shot face anti-spoofing (FAS) is a key technique for securing face recognition systems, and it requires only static images as input. However, single-shot FAS remains a challenging and under-explored problem due to two main reasons: 1) on the data side, learning FAS from RGB images is largely context-dependent, and single-shot images without additional annotations contain limited semantic information. 2) on the model side, existing single-shot FAS models are infeasible to provide proper evidence for their decisions, and FAS methods based on depth estimation require expensive per-pixel annotations. To address these issues, a large binocular NIR image dataset (BNI-FAS) is constructed and published, which contains more than 300,000 real face and plane attack images, and an Interpretable FAS Transformer (IFAST) is proposed that requires only weak supervision to produce interpretable predictions. Our IFAST can produce pixel-wise disparity maps by the proposed disparity estimation Transformer with Dynamic Matching Attention (DMA) block. Besides, a well-designed confidence map generator is adopted to cooperate with the proposed dual-teacher distillation module to obtain the final discriminant results. The comprehensive experiments show that our IFAST can achieve state-of-the-art results on BNI-FAS, proving the effectiveness of the single-shot FAS based on binocular NIR images.


title: Directly Fine-Tuning Diffusion Models on Differentiable Rewards

abstract: We present Direct Reward Fine-Tuning (DRaFT), a simple and effective method for fine-tuning diffusion models to maximize differentiable reward functions, such as scores from human preference models. We first show that it is possible to backpropagate the reward function gradient through the full sampling procedure, and that doing so achieves strong performance on a variety of rewards, outperforming reinforcement learning-based approaches. We then propose more efficient variants of DRaFT: DRaFT-K, which truncates backpropagation to only the last K steps of sampling, and DRaFT-LV, which obtains lower-variance gradient estimates for the case when K=1. We show that our methods work well for a variety of reward functions and can be used to substantially improve the aesthetic quality of images generated by Stable Diffusion 1.4. Finally, we draw connections between our approach and prior work, providing a unifying perspective on the design space of gradient-based fine-tuning algorithms.


title: Adversarial Machine Learning in Latent Representations of Neural Networks

abstract: Distributed deep neural networks (DNNs) have been shown to reduce the computational burden of mobile devices and decrease the end-to-end inference latency in edge computing scenarios. While distributed DNNs have been studied, to the best of our knowledge the resilience of distributed DNNs to adversarial action still remains an open problem. In this paper, we fill the existing research gap by rigorously analyzing the robustness of distributed DNNs against adversarial action. We cast this problem in the context of information theory and introduce two new measurements for distortion and robustness. Our theoretical findings indicate that (i) assuming the same level of information distortion, latent features are always more robust than input representations; (ii) the adversarial robustness is jointly determined by the feature dimension and the generalization capability of the DNN. To test our theoretical findings, we perform extensive experimental analysis by considering 6 different DNN architectures, 6 different approaches for distributed DNN and 10 different adversarial attacks to the ImageNet-1K dataset. Our experimental results support our theoretical findings by showing that the compressed latent representations can reduce the success rate of adversarial attacks by 88% in the best case and by 57% on the average compared to attacks to the input space.


title: Growing Extended Laughlin States in a Quantum Gas Microscope: A Patchwork Construction

abstract: The study of fractional Chern insulators and their exotic anyonic excitations poses a major challenge in current experimental and theoretical research. Quantum simulators, in particular ultracold atoms in optical lattices, provide a promising platform to realize, manipulate, and understand such systems with a high degree of controllability. Recently, an atomic $\nu=1/2$ Laughlin state has been realized experimentally for a small system of two particles on 4 by 4 sites. The next challenge concerns the preparation of Laughlin states in extended systems, ultimately giving access to anyonic braiding statistics or gapless chiral edge-states in systems with open boundaries. Here, we propose and analyze an experimentally feasible scheme to grow larger Laughlin states by connecting multiple copies of the already existing 4-by-4-system. First, we present a minimal setting obtained by coupling two of such patches, producing an extended 8-by-4-system with four particles. Then, we analyze different preparation schemes, setting the focus on two shapes for the extended system, and discuss their respective advantages: While growing strip-like lattices could give experimental access to the central charge, square-like geometries are advantageous for creating quasi-hole excitations in view of braiding protocols. We highlight the robust quantization of the fractional quasi-hole charge upon using our preparation protocol. We benchmark the performance of our patchwork preparation scheme by comparing it to a protocol based on coupling one-dimensional chains. We find that the patchwork approach consistently gives higher target-state fidelities, especially for elongated systems. The results presented here pave the way towards near-term implementations of extended Laughlin states in quantum gas microscopes and the subsequent exploration of exotic properties of topologically ordered systems in experiments.


title: Maximal Volume Matrix Cross Approximation for Image Compression and Least Squares Solution

abstract: We study the classic cross approximation of matrices based on the maximal volume submatrices. Our main results consist of an improvement of a classic estimate for matrix cross approximation and a greedy approach for finding the maximal volume submatrices. Indeed, we present a new proof of a classic estimate of the inequality with an improved constant. Also, we present a family of greedy maximal volume algorithms which improve the error bound of cross approximation of a matrix in the Chebyshev norm and also improve the computational efficiency of classic maximal volume algorithm. The proposed algorithms are shown to have theoretical guarantees of convergence. Finally, we present two applications: one is image compression and the other is least squares approximation of continuous functions. Our numerical results in the end of the paper demonstrate the effective performances of our approach.


title: Relevance of Precession for Tests of the Black Hole No Hair Theorems

abstract: The multipole moments of black holes in general relativity obey certain consistency relations known as the no-hair theorems. The details of this multipolar structure are imprinted into the gravitational waves emitted by binary black holes, particularly if the binary is precessing. If black holes do not obey the vacuum field equations of general relativity, then the no-hair theorems may be broken, and the observed gravitational waves will be modified, thus providing an important test of the no-hair theorems. Recently, analytic solutions to the precession dynamics and inspiral waveforms were computed within the context of binaries possessing non-axisymmetric mass quadrupole moments, which are parametrized by a modulus $q_{m}$ and phase $a_{m}$ with $m = 1,2$ the azimuthal spherical harmonic number. Here, we use a Fisher analysis to study plausible constraints one may obtain on generic, non-axisymmetry quadrupole configurations using current and future ground-based detectors. For non-precessing binaries, we generically find that no meaningful constraints can be placed on the non-axisymmetry parameters $(q_{m}, a_{m})$ due to the presence of strong degeneracies with other waveform parameters. For precessing configurations, the exact value of the uncertainty is strongly dependent on the sky location, system orientation relative to the line of sight, and initial inclination angle of the orbital angular momentum. After averaging over these parameters, we find that with GWTC-3-like events, one should be able to plausibly constraint non-axisymmetric mass quadrupole deviations to $\Delta q_{m} \sim 10^{-2}$ for LIGO at design sensitivity, and $\Delta q_{m} \sim 10^{-4}$ for the same sources with Einstein Telescope and Cosmic Explorer.


title: The Surface Mass Density of the Milky Way: Does the Traditional $K_Z$ Approach Work in the Context of New Surveys?

abstract: We revisit the classical $K_Z$ problem -- determination of the vertical force and implied total mass density distribution of the Milky Way disk -- for a wide range of Galactocentric radius and vertical height using chemically selected thin and thick disk samples based on APOGEE spectroscopy combined with the Gaia astrometry. We derived the velocity dispersion profiles in Galactic cylindrical coordinates, and solved the Jeans Equation for the two samples separately. The result is surprising that the total surface mass density as a function of vertical height as derived for these two chemically distinguished populations are different. The discrepancies are larger in the inner compared to the outer Galaxy, with the density calculated from thick disk being larger, independent of the Galactic radius. Furthermore, while there is an overall good agreement between the total mass density derived for the thick disk population and the Standard Halo Model for vertical heights larger than 1 kpc, close to the midplane the mass density observed using the thick disk population is larger than the predicted from the Standard Halo Model. We explore various implications of these discrepancies, and speculate their sources, including problems associated with the assumed density laws, velocity dispersion profiles, and the Galactic rotation curve, potential non-equilibrium of the Galactic disk, or a failure of the NFW dark matter halo profile for the Milky Way. We conclude that the growing detail in hand on the chemodynamical distributions of Milky Way stars challenges traditional analytical treatments of the $K_Z$ problem.


title: CNN-based automatic segmentation of Lumen & Media boundaries in IVUS images using closed polygonal chains

abstract: We propose an automatic segmentation method for lumen and media with irregular contours in IntraVascular ultra-sound (IVUS) images. In contrast to most approaches that broadly label each pixel as either lumen, media, or background, we propose to approximate the lumen and media contours by closed polygonal chains. The chain vertices are placed at fixed angles obtained by dividing the entire 360\degree~angular space into equally spaced angles, and we predict their radius using an adaptive-subband-decomposition CNN. We consider two loss functions during training. The first is a novel loss function using the Jaccard Measure (JM) to quantify the similarities between the predicted lumen and media segments and the corresponding ground-truth image segments. The second loss function is the traditional Mean Squared Error. The proposed architecture significantly reduces computational costs by replacing the popular auto-encoder structure with a simple CNN as the encoder and the decoder is reduced to simply joining the consecutive predicted points. We evaluated our network on the publicly available IVUS-Challenge-2011 dataset using two performance metrics, namely JM and Hausdorff Distance (HD). The evaluation results show that our proposed network mostly outperforms the state-of-the-art lumen and media segmentation methods.


title: Evolutionary Search and Theoretical Study of Silicene Grain Boundaries' Mechanical Properties

abstract: Defects such as grain boundaries (GBs) are almost inevitable during the synthesis process of 2D materials. To take advantage of the fascinating properties of 2D materials, understanding the nature and impact of various GB structures on the pristine 2D sheet is crucial. In this work, using an evolutionary algorithm search, we predict a wide variety of silicene GB structures with very different atomic structures compared to those found in graphene or hexagonal boron-nitride. Twenty-one GBs with the lowest energy were validated by density functional theory (DFT) - a majority of which were previously unreported to our best knowledge. Based on the diversity of the GB predictions, we found that the formation energy and mechanical properties can be dramatically altered by adatoms positions within a GB and certain types of atomic structures, such as four-atom rings. To study the mechanical behavior of these GBs, we apply strain to the GB structures stepwise and use DFT calculations to investigate the mechanical properties of 9 representative structures. It is observed that GB structures based on pentagon-heptagon pairs are likely to have similar or higher in-plane stiffness and strength compared with the zigzag orientation of pristine silicene. However, an adatom located at the hollow site of a heptagon ring can significantly deteriorate the mechanical strength. For all the structures, the in-plane stiffness and strength were found to decrease with increasing formation energy. For the failure behavior of GB structures, it was found that GB structures based on pentagon-heptagon pairs have failure behavior similar to graphene. We also found that the GB structures with atoms positioned outside of the 2D plane tend to experience phase transitions before failure. Utilizing the evolutionary algorithm, we locate diverse silicene GBs and obtain useful information for their mechanical properties.


title: Two-fluid model analysis of the terahertz conductivity of YBaCuO samples: optimally doped, underdoped and overdoped cases

abstract: The complex conductivity of YBa$_2$Cu$_3$O$_{7-\delta}$ samples representing the optimally doped, the underdoped and the overdoped stoichiometry was measured using time-domain terahertz spectroscopy. In the normal state, the frequency dependence is described by the Drude model. Below the critical temperature $T_\mathrm{c}$, the two-fluid model was successfully employed to fit all the spectra, from 5 K up to $T_\mathrm{c}$. The temperature behaviour of fundamental parameters such as the scattering time $\tau$, the superfluid fraction $f_\mathrm{s}$ and the conductivity $\sigma$ was investigated at given frequencies. The real part of the conductivity $\sigma_1(T)$ exhibits a coherence-like peak at low frequencies, which slightly shifts with increasing frequency whereas its height decreases. It can be observed for all three stoichiometries and its exact shape depends on the quality of the sample. A further analysis shows that this peak is a consequence of the competition between the scattering time $\tau(T)$ and the superfluid fraction $f_\mathrm{s}(T)$. The decrease of the superfluid fraction towards $T_\mathrm{c}$ depends on the reduced temperature with a power law close to 2, suggesting a dirty d-wave superconductor case for all levels of doping.


title: Sharper Convergence Guarantees for Federated Learning with Partial Model Personalization

abstract: Partial model personalization, which encompasses both shared and personal variables in its formulation, is a critical optimization problem in federated learning. It balances individual client needs with collective knowledge utilization, and serves as a general formulation covering various key scenarios, ranging from fully shared to fully personalized federated learning. This paper introduces two effective algorithms, FedAvg-P and Scaffold-P, to solve this problem and provides sharp convergence analyses, quantifying the influence of gradient variance, local steps, and partial client sampling on their performance. Our established rates surpass existing results and, meanwhile, are based on more relaxed assumptions. Additionally, our analyses are also applicable to fully shared or fully personalized federated learning, matching or even outperforming their best known convergence rates. Numerical experiments corroborate our theoretical findings.


title: Can Sensitive Information Be Deleted From LLMs? Objectives for Defending Against Extraction Attacks

abstract: Pretrained language models sometimes possess knowledge that we do not wish them to, including memorized personal information and knowledge that could be used to harm people. They can also output toxic or harmful text. To mitigate these safety and informational issues, we propose an attack-and-defense framework for studying the task of deleting sensitive information directly from model weights. We study direct edits to model weights because (1) this approach should guarantee that particular deleted information is never extracted by future prompt attacks, and (2) it should protect against whitebox attacks, which is necessary for making claims about safety/privacy in a setting where publicly available model weights could be used to elicit sensitive information. Our threat model assumes that an attack succeeds if the answer to a sensitive question is located among a set of B generated candidates, based on scenarios where the information would be insecure if the answer is among B candidates. Experimentally, we show that even state-of-the-art model editing methods such as ROME struggle to truly delete factual information from models like GPT-J, as our whitebox and blackbox attacks can recover "deleted" information from an edited model 38% of the time. These attacks leverage two key observations: (1) that traces of deleted information can be found in intermediate model hidden states, and (2) that applying an editing method for one question may not delete information across rephrased versions of the question. Finally, we provide new defense methods that protect against some extraction attacks, but we do not find a single universally effective defense method. Our results suggest that truly deleting sensitive information is a tractable but difficult problem, since even relatively low attack success rates have potentially severe societal implications for real-world deployment of language models.


title: Resilient Model-Free Asymmetric Bipartite Consensus for Nonlinear Multi-Agent Systems against DoS Attacks

abstract: In this letter, we study an unified resilient asymmetric bipartite consensus (URABC) problem for nonlinear multi-agent systems with both cooperative and antagonistic interactions under denial-of-service (DoS) attacks. We first prove that the URABC problem is solved by stabilizing the neighborhood asymmetric bipartite consensus error. Then, we develop a distributed compact form dynamic linearization method to linearize the neighborhood asymmetric bipartite consensus error. By using an extended discrete state observer to enhance the robustness against unknown dynamics and an attack compensation mechanism to eliminate the adverse effects of DoS attacks, we finally propose a distributed resilient model-free adaptive control algorithm to solve the URABC problem. A numerical example validates the proposed results.


title: Around traces and quasitraces

abstract: This paper presents a survey of results on traces and quasitraces on C$^*$-algebras, and it provides some new results on traces on ultrapowers and on the existence of faithful traces. As for the former, we exhibit a sequence of traceless simple, separable, unital, nuclear C$^*$-algebras whose ultrapower does admit a quasitrace (and likely also a trace). We characterize in different ways C$^*$-algebras that admit a faithful trace, respectively, where each quotient of the C$^*$-algebra admits a faithful trace.


title: Momentum-space imaging of ultra-thin electron liquids in delta-doped silicon

abstract: Two-dimensional dopant layers ($\delta$-layers) in semiconductors provide the high-mobility electron liquids (2DELs) needed for nanoscale quantum-electronic devices. Key parameters such as carrier densities, effective masses, and confinement thicknesses for 2DELs have traditionally been extracted from quantum magnetotransport. In principle, the parameters are immediately readable from the one-electron spectral function that can be measured by angle-resolved photoemission spectroscopy (ARPES). Here, buried 2DEL $\delta$-layers in silicon are measured with soft X-ray (SX) ARPES to obtain detailed information about their filled conduction bands and extract device-relevant properties. This study takes advantage of the larger probing depth and photon energy range of SX-ARPES relative to vacuum ultraviolet (VUV) ARPES to accurately measure the $\delta$-layer electronic confinement. The measurements are made on ambient-exposed samples and yield extremely thin ($\approx 1$ $nm$) and dense ($\approx$ $10^{14}$ $cm^2$) 2DELs. Critically, this method is used to show that $\delta$-layers of arsenic exhibit better electronic confinement than $\delta$-layers of phosphorus fabricated under identical conditions.


title: QR TPM in Programmable Low-Power Devices

abstract: Trusted Platform Modules (TPMs), which serve as the root of trust in secure systems, are secure crypto-processors that carry out cryptographic primitives. Should large-scale quantum computing become a reality, the cryptographic primitives adopted in the TPM 2.0 standard will no longer be secure. Thus, the design of TPMs that provide Quantum Resistant (QR) primitives is of utmost importance, in particular with the restrictions imposed by embedded systems. In this paper, we investigate the deployment of QR primitives and protocols in the standard TPM 2.0. Cryptographic algorithms that are already in the NIST QR cryptography standardization process, as well as an Oblivious Transfer (OT), a fundamental cryptographic primitive, are the QR cryptographic schemes selected to extend TPM 2.0. In particular, the Kyber algorithm for key encapsulation, the Dilithium algorithm for digital signature, and a 3-round Random Oblivious Transfer (ROT) protocol, supporting protocols such as Multi-Party Computation and Private Set Intersection (PSI). The QR extended TPM 2.0 is implemented in ARM and RISC-V embedded processors, its computational requirements are analysed and experimentally evaluated in comparison to the standard TPM. It is shown that Kyber and Dilithium are faster at creating keys than RSA, due to the key size and secure random sampling required in RSA, while they meet the same performance level as ECC. For digital signatures, both in signature creation and verification, Dilithium is on par with RSA and ECC. The ROT protocol shows decent performance and its support required small modifications to the TPM. This paper also shows that it would be possible to backport the required code to already available TPMs to ensure that current TPMs remain secure against quantum adversaries.


title: Intuitive or Dependent? Investigating LLMs' Behavior Style to Conflicting Prompts

abstract: This study investigates the behaviors of Large Language Models (LLMs) when faced with conflicting prompts versus their internal memory. This will not only help to understand LLMs' decision mechanism but also benefit real-world applications, such as retrieval-augmented generation (RAG). Drawing on cognitive theory, we target the first scenario of decision-making styles where there is no superiority in the conflict and categorize LLMs' preference into dependent, intuitive, and rational/irrational styles. Another scenario of factual robustness considers the correctness of prompt and memory in knowledge-intensive tasks, which can also distinguish if LLMs behave rationally or irrationally in the first scenario. To quantify them, we establish a complete benchmarking framework including a dataset, a robustness evaluation pipeline, and corresponding metrics. Extensive experiments with seven LLMs reveal their varying behaviors. And, with role play intervention, we can change the styles, but different models present distinct adaptivity and upper-bound. One of our key takeaways is to optimize models or the prompts according to the identified style. For instance, RAG models with high role play adaptability may dynamically adjust the interventions according to the quality of retrieval results -- being dependent to better leverage informative context; and, being intuitive when external prompt is noisy.


title: An Isomorphism Theorem for Arithmetic Complexes

abstract: We consider generalizations of certain arithmetic complexes appearing in work of Raicu and VandeBogert in connection with the study of stable sheaf cohomology on flag varieties. Defined over the ring of integer valued polynomials, we prove an isomorphism of these complexes as conjectured by Gao, Raicu, and VandeBogert. In particular, this gives a more conceptual proof of an identification between the stable sheaf cohomology of hook and two column partition Schur functors applied to the cotangent sheaf of projective space.


title: Networked Inequality: Preferential Attachment Bias in Graph Neural Network Link Prediction

abstract: Graph neural network (GNN) link prediction is increasingly deployed in citation, collaboration, and online social networks to recommend academic literature, collaborators, and friends. While prior research has investigated the dyadic fairness of GNN link prediction, the within-group (e.g., queer women) fairness and "rich get richer" dynamics of link prediction remain underexplored. However, these aspects have significant consequences for degree and power imbalances in networks. In this paper, we shed light on how degree bias in networks affects Graph Convolutional Network (GCN) link prediction. In particular, we theoretically uncover that GCNs with a symmetric normalized graph filter have a within-group preferential attachment bias. We validate our theoretical analysis on real-world citation, collaboration, and online social networks. We further bridge GCN's preferential attachment bias with unfairness in link prediction and propose a new within-group fairness metric. This metric quantifies disparities in link prediction scores within social groups, towards combating the amplification of degree and power disparities. Finally, we propose a simple training-time strategy to alleviate within-group unfairness, and we show that it is effective on citation, social, and credit networks.


title: Calabi-Yau structures on the complexifications of rank two symmeric spaces

abstract: In this paper, we prove that there exists a $C^{\infty}$-Calabi-Yau structure on the whole of the complexification $G^{\mathbb C}/K^{\mathbb C}$ of a rank two symmetric space $G/K$ of compact type. The proof is performed by deriving a relation (which differs from the known relation somewhat) between the complex Hessian of a real-valued $C^{\infty}$-function $\psi$ on $G^{\mathbb C}/K^{\mathbb C}$ and the Hessian of the function $\rho:=\psi|_{{\rm Exp}_o(\mathfrak a)}\circ{\rm Exp}_o|_{\mathfrak a}$ on a maximal abelian subspace $\mathfrak a$ of the normal space $T_o^{\perp}(G\cdot o)(=T_o(G^d\cdot o)\subset\mathfrak g^d)$ of the orbit $G\cdot o(=G/K)$ in $G^{\mathbb C}/K^{\mathbb C}$ at the base point $o$, where ${\rm Exp}_o$ is the exponential map of $G^{\mathbb C}/K^{\mathbb C}$ at $o$ and $\mathfrak g^d$ is the Lie algebra of the dual $G^d$ of $G$. This relation is derived in a new calculation method by using the explicit descriptions of the shape operators of the orbits of the isotropy action $K\curvearrowright G^d/K$ and the Hermann type action $G\curvearrowright G^{\mathbb C}/K^{\mathbb C}$.


title: Enumerating minimal solution sets for metric graph problems

abstract: Problems from metric graph theory like Metric Dimension, Geodetic Set, and Strong Metric Dimension have recently had a strong impact in parameterized complexity by being the first known problems in NP to admit double-exponential lower bounds in the treewidth, and even in the vertex cover number for the latter, assuming the Exponential Time Hypothesis. We initiate the study of enumerating minimal solution sets for these problems and show that they are also of great interest in enumeration. Specifically, we show that enumerating minimal resolving sets in graphs and minimal geodetic sets in split graphs are equivalent to enumerating minimal transversals in hypergraphs (denoted Trans-Enum), whose solvability in total-polynomial time is one of the most important open problems in algorithmic enumeration. This provides two new natural examples to a question that emerged in recent works: for which vertex (or edge) set graph property $\Pi$ is the enumeration of minimal (or maximal) subsets satisfying $\Pi$ equivalent to Trans-Enum? As very few properties are known to fit within this context -- namely, those related to minimal domination -- our results make significant progress in characterizing such properties, and provide new angles to approach Trans-Enum. In contrast, we observe that minimal strong resolving sets can be enumerated with polynomial delay. Additionally, we consider cases where our reductions do not apply, namely graphs with no long induced paths, and show both positive and negative results related to the enumeration and extension of partial solutions.


title: The Flux Operator

abstract: Converged computing brings together the best of both worlds for high performance computing (HPC) and cloud-native communities. In fact, the economic impact of cloud-computing, and need for portability, flexibility, and manageability make it not important, but inevitable. Navigating this uncharted territory requires not just innovation in the technology space, but also effort toward collaboration and sharing of ideas. With these goals in mind, this work first tackles the central component of running batch workflows, whether in cloud or HPC: the workload manager. For cloud, Kubernetes has become the de facto tool for this kind of batch orchestration. For HPC, the next-generation HPC workload manager Flux Framework is analogous -- combining fully hierarchical resource management and graph-based scheduling to support intelligent scheduling and job management. Convergence of these managers would mean the implementation of Flux inside of Kubernetes, allowing for hierarchical resource management and scheduling that scales impressively without burdening the Kubernetes scheduler itself. This paper introduces the Flux Operator -- an on-demand HPC workload manager that is easily deployed in Kubernetes. The work here highlights design decisions, mapping of components between environments, experimental features, and shares the results of experiments that compare performance with an equivalent operator in the space, the MPI Operator. Finally, discussion closes with a review of challenges remaining, and hopes for the future for improved technological innovation and collaboration.


title: The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)

abstract: Large multimodal models (LMMs) extend large language models (LLMs) with multi-sensory skills, such as visual understanding, to achieve stronger generic intelligence. In this paper, we analyze the latest model, GPT-4V(ision), to deepen the understanding of LMMs. The analysis focuses on the intriguing tasks that GPT-4V can perform, containing test samples to probe the quality and genericity of GPT-4V's capabilities, its supported inputs and working modes, and the effective ways to prompt the model. In our approach to exploring GPT-4V, we curate and organize a collection of carefully designed qualitative samples spanning a variety of domains and tasks. Observations from these samples demonstrate that GPT-4V's unprecedented ability in processing arbitrarily interleaved multimodal inputs and the genericity of its capabilities together make GPT-4V a powerful multimodal generalist system. Furthermore, GPT-4V's unique capability of understanding visual markers drawn on input images can give rise to new human-computer interaction methods such as visual referring prompting. We conclude the report with in-depth discussions on the emerging application scenarios and the future research directions for GPT-4V-based systems. We hope that this preliminary exploration will inspire future research on the next-generation multimodal task formulation, new ways to exploit and enhance LMMs to solve real-world problems, and gaining better understanding of multimodal foundation models. Finally, we acknowledge that the model under our study is solely the product of OpenAI's innovative work, and they should be fully credited for its development. Please see the GPT-4V contributions paper for the authorship and credit attribution: https://cdn.openai.com/contributions/gpt-4v.pdf


title: Out-of-Equilibrium Fluctuation-Dissipation Bounds

abstract: We prove a general inequality between the charge current and its fluctuations valid for any non-interacting coherent electronic conductor and for any stationary out-of-equilibrium condition, thereby going beyond established fluctuation-dissipation relations. The developed fluctuation-dissipation bound saturates at large temperature bias and reveals additional insight for heat engines, since it limits the output power by power fluctuations. It is valid when the thermodynamic uncertainty relations break down due to quantum effects and provides stronger constraints close to thermovoltage.


title: Long time dynamics of a fractional dissipative model of electroconvection in bounded domains

abstract: We consider a nonlocal nonlinear model with fractional diffusion motivated by studies of electroconvection phenomena in incompressible viscous fluids. We address the global well-posedness, global regularity and long time dynamics of the model in bounded smooth domains with Dirichlet boundary conditions. We prove the existence and uniqueness of exponentially decaying in time solutions for $H^1$ initial data regardless of the fractional dissipative regularity. In the presence of time independent body forces in the fluid, we prove the existence of a compact finite dimensional global attractor. In the case of periodic boundary conditions, we prove that the unique smooth solution is globally analytic in time, and belongs to a Gevrey class of functions that depends on the dissipative regularity of the model.


title: Representing the inverse map as a composition of quadratics in a finite field of characteristic $2$

abstract: In 1953, Carlitz~\cite{Car53} showed that all permutation polynomials over $\F_q$, where $q>2$ is a power of a prime, are generated by the special permutation polynomials $x^{q-2}$ (the inversion) and $ ax+b$ (affine functions, where $0\neq a, b\in \F_q$). Recently, Nikova, Nikov and Rijmen~\cite{NNR19} proposed an algorithm (NNR) to find a decomposition of the inverse function in quadratics, and computationally covered all dimensions $n\leq 16$. Petrides~\cite{P23} found a class of integers for which it is easy to decompose the inverse into quadratics, and improved the NNR algorithm, thereby extending the computation up to $n\leq 32$. Here, we extend Petrides' result, as well as we propose a number theoretical approach, which allows us to cover easily all (surely, odd) exponents up to~$250$, at least.


title: Data Filtering Networks

abstract: Large training sets have become a cornerstone of machine learning and are the foundation for recent advances in language modeling and multimodal learning. While data curation for pre-training is often still ad-hoc, one common paradigm is to first collect a massive pool of data from the Web and then filter this candidate pool down to an actual training set via various heuristics. In this work, we study the problem of learning a data filtering network (DFN) for this second step of filtering a large uncurated dataset. Our key finding is that the quality of a network for filtering is distinct from its performance on downstream tasks: for instance, a model that performs well on ImageNet can yield worse training sets than a model with low ImageNet accuracy that is trained on a small amount of high-quality data. Based on our insights, we construct new data filtering networks that induce state-of-the-art image-text datasets. Specifically, our best performing dataset DFN-5B enables us to train state-of-the-art CLIP models for their compute budgets: among other improvements on a variety of tasks, a ViT-H trained on our dataset achieves 84.4% zero-shot transfer accuracy on ImageNet, out-performing models trained on other datasets such as LAION-2B, DataComp-1B, or OpenAI's WIT. In order to facilitate further research in dataset design, we also release a new 2 billion example dataset DFN-2B and show that high performance data filtering networks can be trained from scratch using only publicly available data.


title: Classification of Potholes Based on Surface Area Using Pre-Trained Models of Convolutional Neural Network

abstract: Potholes are fatal and can cause severe damage to vehicles as well as can cause deadly accidents. In South Asian countries, pavement distresses are the primary cause due to poor subgrade conditions, lack of subsurface drainage, and excessive rainfalls. The present research compares the performance of three pre-trained Convolutional Neural Network (CNN) models, i.e., ResNet 50, ResNet 18, and MobileNet. At first, pavement images are classified to find whether images contain potholes, i.e., Potholes or Normal. Secondly, pavements images are classi-fied into three categories, i.e., Small Pothole, Large Pothole, and Normal. Pavement images are taken from 3.5 feet (waist height) and 2 feet. MobileNet v2 has an accuracy of 98% for detecting a pothole. The classification of images taken at the height of 2 feet has an accuracy value of 87.33%, 88.67%, and 92% for classifying the large, small, and normal pavement, respectively. Similarly, the classification of the images taken from full of waist (FFW) height has an accuracy value of 98.67%, 98.67%, and 100%.


title: Anomalous Photoresponse in a Reduced Metal-Semiconductor Hybrid of Nickel and Titanium Oxide

abstract: Eutectic NiTiO$_3$-TiO$_2$ samples and their H$_2$ reduced Ni-TiO$_2$ samples, where high aspect ratio TiO$_2$ nanostructures are axially decorated with nodular Ni globules, are thoroughly explored to understand their effect in photo-response. We show that by employing this novel eutectic architecture, effectively exploiting the nano-structuring process along with the chosen material properties, the overall efficiency of the ensuing photoactive device is improved. We also show the competing photo-driven and photothermal-driven carrier mechanisms to define the total photo-response of the system. Additionally, the ability to function self-powered poses this approach as a potential strategy for achieving efficient photodetectors.


title: CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets

abstract: Large language models (LLMs) are often augmented with tools to solve complex tasks. By generating code snippets and executing them through task-specific Application Programming Interfaces (APIs), they can offload certain functions to dedicated external modules, such as image encoding and performing calculations. However, most existing approaches to augment LLMs with tools are constrained by general-purpose APIs and lack the flexibility for tailoring them to specific tasks. In this work, we present CRAFT, a general tool creation and retrieval framework for LLMs. It creates toolsets specifically curated for the tasks and equips LLMs with a component that retrieves tools from these sets to enhance their capability to solve complex tasks. For each task, we collect specific code solutions by prompting GPT-4 to solve the training examples. Following a validation step ensuring the correctness, these solutions are abstracted into code snippets to enhance reusability, and deduplicated for higher quality. At inference time, the language model retrieves snippets from the toolsets and then executes them or generates the output conditioning on the retrieved snippets. Our method is designed to be flexible and offers a plug-and-play approach to adapt off-the-shelf LLMs to unseen domains and modalities, without any finetuning. Experiments on vision-language, tabular processing, and mathematical reasoning tasks show that our approach achieves substantial improvements compared to strong baselines. In addition, our in-depth analysis reveals that: (1) consistent performance improvement can be achieved by scaling up the number of tools and the capability of the backbone models; (2) each component of our approach contributes to the performance gains; (3) the created tools are well-structured and reliable with low complexity and atomicity. The code is available at https://github.com/lifan-yuan/CRAFT.


title: Spinning waveforms from KMOC at leading order

abstract: We provide the analytic waveform in time domain for the scattering of two Kerr black holes at leading order in the post-Minkowskian expansion and up to fourth order in both spins. The result is obtained by the generalization of the KMOC formalism to radiative observables, combined with the analytic continuation of the five-point scattering amplitude to complex kinematics. We use analyticity arguments to express the waveform directly in terms of the three-point coupling of the graviton to the spinning particles and the gravitational Compton amplitudes, completely bypassing the need to compute and integrate the five-point amplitude. In particular, this allows to easily include higher-order spin contributions for any spinning compact body. Finally, in the spinless case we find a new compact and gauge-invariant representation of the Kovacs-Thorne waveform.


title: FACTS: First Amplify Correlations and Then Slice to Discover Bias

abstract: Computer vision datasets frequently contain spurious correlations between task-relevant labels and (easy to learn) latent task-irrelevant attributes (e.g. context). Models trained on such datasets learn "shortcuts" and underperform on bias-conflicting slices of data where the correlation does not hold. In this work, we study the problem of identifying such slices to inform downstream bias mitigation strategies. We propose First Amplify Correlations and Then Slice to Discover Bias (FACTS), wherein we first amplify correlations to fit a simple bias-aligned hypothesis via strongly regularized empirical risk minimization. Next, we perform correlation-aware slicing via mixture modeling in bias-aligned feature space to discover underperforming data slices that capture distinct correlations. Despite its simplicity, our method considerably improves over prior work (by as much as 35% precision@10) in correlation bias identification across a range of diverse evaluation settings. Our code is available at: https://github.com/yvsriram/FACTS.


title: First shot of the smoking gun: probing the electroweak phase transition in the 2HDM with novel searches for $A \to ZH$ in $\ell^+ \ell^- t \bar{t}$ and $\nu \nu b \bar{b}$ final states

abstract: Recently the ATLAS collaboration has reported the first results of searches for heavy scalar resonances decaying into a $Z$ boson and a lighter new scalar resonance, where the $Z$ boson decays leptonically and the lighter scalar decays into a top-quark pair, giving rise to $\ell^+ \ell^- t \bar{t}$ final states. This had previously been identified as a smoking-gun signature at the LHC for a first-order electroweak phase transition (FOEWPT) within the framework of two Higgs doublet models (2HDMs). In addition, ATLAS also presented new limits where the $Z$ boson decays into pairs of neutrinos and the lighter scalar resonance into bottom-quark pairs, giving rise to the $\nu \nu b \bar b$ final state. We analyze the impact of these new searches on the 2HDM parameter space, with emphasis on their capability to probe currently allowed 2HDM regions featuring a strong FOEWPT. We also study the complementarity of these new searches with other LHC probes that could target the FOEWPT region of the 2HDM. Remarkably, the ATLAS search in the $\ell^+ \ell^- t \bar{t}$ final state shows a local $2.85\,\sigma$ excess (for masses of about 650 GeV and 450 GeV for the heavy and light resonance) in the 2HDM parameter region that would yield a FOEWPT in the early universe, which could constitute the first experimental hint of baryogenesis at the electroweak scale. We analyze the implications of this excess, and discuss the detectability prospects for the associated gravitational wave signal from the FOEWPT. Furthermore, we project the sensitivity reach of the $\ell^+ \ell^- t \bar{t}$ signature for the upcoming runs of the LHC. Finally, we introduce the python package thdmTools, a state-of-art tool for the exploration of the 2HDM.


title: The distribution of the maximum of independent resetting Brownian motions

abstract: The probability distribution of the maximum $M_t$ of a single resetting Brownian motion (RBM) of duration $t$ and resetting rate $r$, properly centred and scaled, is known to converge to the standard Gumbel distribution of the classical extreme value theory. This Gumbel law describes the typical fluctuations of $M_t$ around its average $\sim \ln (r t)$ for large $t$ on a scale of $O(1)$. Here we compute the large-deviation tails of this distribution when $M_t = O(t)$ and show that the large-deviation function has a singularity where the second derivative is discontinuous, signalling a dynamical phase transition. Then we consider a collection of independent RBMs with initial (and resetting) positions uniformly distributed with a density $\rho$ over the negative half-line. We show that the fluctuations in the initial positions of the particles modify the distribution of $M_t$. The average over the initial conditions can be performed in two different ways, in analogy with disordered systems: (i) the annealed case where one averages over all possible initial conditions and (ii) the quenched case where one considers only the contributions coming from typical initial configurations. We show that in the annealed case, the limiting distribution of the maximum is characterized by a new scaling function, different from the Gumbel law but the large-deviation function remains the same as in the single particle case. In contrast, for the quenched case, the limiting (typical) distribution remains Gumbel but the large-deviation behaviors are new and nontrivial. Our analytical results, both for the typical as well as for the large-deviation regime of $M_t$, are verified numerically with extremely high precision, down to $10^{-250}$ for the probability density of $M_t$.


title: DREAM: Decentralized Reinforcement Learning for Exploration and Efficient Energy Management in Multi-Robot Systems

abstract: Resource-constrained robots often suffer from energy inefficiencies, underutilized computational abilities due to inadequate task allocation, and a lack of robustness in dynamic environments, all of which strongly affect their performance. This paper introduces DREAM - Decentralized Reinforcement Learning for Exploration and Efficient Energy Management in Multi-Robot Systems, a comprehensive framework that optimizes the allocation of resources for efficient exploration. It advances beyond conventional heuristic-based task planning as observed conventionally. The framework incorporates Operational Range Estimation using Reinforcement Learning to perform exploration and obstacle avoidance in unfamiliar terrains. DREAM further introduces an Energy Consumption Model for goal allocation, thereby ensuring mission completion under constrained resources using a Graph Neural Network. This approach also ensures that the entire Multi-Robot System can survive for an extended period of time for further missions compared to the conventional approach of randomly allocating goals, which compromises one or more agents. Our approach adapts to prioritizing agents in real-time, showcasing remarkable resilience against dynamic environments. This robust solution was evaluated in various simulated environments, demonstrating adaptability and applicability across diverse scenarios. We observed a substantial improvement of about 25% over the baseline method, leading the way for future research in resource-constrained robotics.


title: Local Changes in Protein Filament Properties Drive Large-Scale Membrane Transformations Involved in Endosome Tethering and Fusion

abstract: Large-scale cellular transformations are triggered by subtle physical and structural changes in individual biomacromolecular and membrane components. A prototypical example of such an event is the orchestrated fusion of membranes within an endosome that enables transport of cargo and processing of biochemical moieties. In this work, we demonstrate how protein filaments on the endosomal membrane surface can leverage a rigid-to-flexible transformation to elicit a large-scale change in membrane flexibility to enable membrane fusion. We develop a polymer field-theoretic model that captures molecular alignment arising from nematic interactions with varying surface density and fraction of flexible filaments, which are biologically controlled within the endosomal membrane. We then predict the collective elasticity of the filament brush in response to changes in the filament alignment, predicting a greater than 20-fold increase of the effective membrane elasticity over the bare membrane elasticity that is triggered by filament alignment. These results show that the endosome can modulate the filament properties to orchestrate membrane fluidization that facilitates vesicle fusion, providing an example of how active processes that modulate local molecular properties can result in large-scale transformations that are essential to cellular survival.

categories: cond-mat.soft cond-mat.stat-mech physics.bio-ph physics.chem-ph


title: Physics with non-unital algebras? An invitation to the Okubo algebra

abstract: This paper discusses the potential application of the Okubonions, i.e. the Okubo algebra $\mathcal{O}$, within quantum chromodynamics (QCD). The Okubo algebra lacks a unit element and sits in the adjoint representation of its automorphism group $\text{SU}(3)_{\mathcal{O}}$, being fundamentally different from the better-known octonions $\mathbb{O}$. A physical interpretation is proposed in which the Okubonions represent gluons, the gauge bosons of QCD $\text{SU}(3)$ color symmetry, while the octonions represent quarks (and color singlets). However, it is shown that the respective $\text{SU}(3)$ symmetries for Okubonions and octonions are distinct and inequivalent subgroups of $\text{Spin}(8)$ that share no common $\text{SU}(2)$ subgroup. The unusual properties of Okubonions are suggested as a possible source for peculiar QCD phenomena like asymptotic freedom and color confinement, though actual mechanisms remain to be investigated.


title: Fractional Quantum Anomalous Hall Effect in a Graphene Moire Superlattice

abstract: The fractional quantum anomalous Hall effect (FQAHE), the analog of the fractional quantum Hall effect1 at zero magnetic field, is predicted to exist in topological flat bands under spontaneous time-reversal-symmetry breaking. The demonstration of FQAHE could lead to non-Abelian anyons which form the basis of topological quantum computation. So far, FQAHE has been observed only in twisted MoTe2 (t-MoTe2) at moire filling factor v > 1/2. Graphene-based moire superlattices are believed to host FQAHE with the potential advantage of superior material quality and higher electron mobility. Here we report the observation of integer and fractional QAH effects in a rhombohedral pentalayer graphene/hBN moire superlattice. At zero magnetic field, we observed plateaus of quantized Hall resistance Rxy = h/(ve^2) at filling factors v = 1, 2/3, 3/5, 4/7, 4/9, 3/7 and 2/5 of the moire superlattice respectively. These features are accompanied by clear dips in the longitudinal resistance Rxx. In addition, at zero magnetic field, Rxy equals 2h/e^2 at v = 1/2 and varies linearly with the filling factor-similar to the composite Fermi liquid (CFL) in the half-filled lowest Landau level at high magnetic fields. By tuning the gate displacement field D and v, we observed phase transitions from CFL and FQAH states to other correlated electron states. Our graphene system provides an ideal platform for exploring charge fractionalization and (non-Abelian) anyonic braiding at zero magnetic field, especially considering a lateral junction between FQAHE and superconducting regions in the same device.


title: Learning Decentralized Flocking Controllers with Spatio-Temporal Graph Neural Network

abstract: Recently a line of researches has delved the use of graph neural networks (GNNs) for decentralized control in swarm robotics. However, it has been observed that relying solely on the states of immediate neighbors is insufficient to imitate a centralized control policy. To address this limitation, prior studies proposed incorporating $L$-hop delayed states into the computation. While this approach shows promise, it can lead to a lack of consensus among distant flock members and the formation of small clusters, consequently resulting in the failure of cohesive flocking behaviors. Instead, our approach leverages spatiotemporal GNN, named STGNN that encompasses both spatial and temporal expansions. The spatial expansion collects delayed states from distant neighbors, while the temporal expansion incorporates previous states from immediate neighbors. The broader and more comprehensive information gathered from both expansions results in more effective and accurate predictions. We develop an expert algorithm for controlling a swarm of robots and employ imitation learning to train our decentralized STGNN model based on the expert algorithm. We simulate the proposed STGNN approach in various settings, demonstrating its decentralized capacity to emulate the global expert algorithm. Further, we implemented our approach to achieve cohesive flocking, leader following and obstacle avoidance by a group of Crazyflie drones. The performance of STGNN underscores its potential as an effective and reliable approach for achieving cohesive flocking, leader following and obstacle avoidance tasks.


title: The NANOGrav 12.5-year data set: A computationally efficient eccentric binary search pipeline and constraints on an eccentric supermassive binary candidate in 3C 66B

abstract: The radio galaxy 3C 66B has been hypothesized to host a supermassive black hole binary (SMBHB) at its center based on electromagnetic observations. Its apparent 1.05-year period and low redshift ($\sim0.02$) make it an interesting testbed to search for low-frequency gravitational waves (GWs) using Pulsar Timing Array (PTA) experiments. This source has been subjected to multiple searches for continuous GWs from a circular SMBHB, resulting in progressively more stringent constraints on its GW amplitude and chirp mass. In this paper, we develop a pipeline for performing Bayesian targeted searches for eccentric SMBHBs in PTA data sets, and test its efficacy by applying it on simulated data sets with varying injected signal strengths. We also search for a realistic eccentric SMBHB source in 3C 66B using the NANOGrav 12.5-year data set employing PTA signal models containing Earth term-only as well as Earth+Pulsar term contributions using this pipeline. Due to limitations in our PTA signal model, we get meaningful results only when the initial eccentricity $e_0<0.5$ and the symmetric mass ratio $\eta>0.1$. We find no evidence for an eccentric SMBHB signal in our data, and therefore place 95% upper limits on the PTA signal amplitude of $88.1\pm3.7$ ns for the Earth term-only and $81.74\pm0.86$ ns for the Earth+Pulsar term searches for $e_0<0.5$ and $\eta>0.1$. Similar 95% upper limits on the chirp mass are $(1.98 \pm 0.05) \times 10^9\,M_{\odot}$ and $(1.81 \pm 0.01) \times 10^9\,M_{\odot}$. These upper limits, while less stringent than those calculated from a circular binary search in the NANOGrav 12.5-year data set, are consistent with the SMBHB model of 3C 66B developed from electromagnetic observations.


title: Self-intercalation as origin of high-temperature ferromagnetism in epitaxially grown Fe5GeTe2 thin films

abstract: The role of self-intercalation in 2D van der Waals materials is key to the understanding of many of their properties. Here we show that the magnetic ordering temperature of thin films of the 2D ferromagnet Fe5GeTe2 is substantially increased by self-intercalated Fe that resides in the van der Waals gaps. The epitaxial films were prepared by molecular beam epitaxy and their magnetic properties explored by element-specific x-ray magnetic circular dichroism that showed ferromagnetic ordering up to 375 K. Both surface and bulk sensitive x-ray absorption modes were used to confirm that the magnetic signal is of an intrinsic nature. Fe occupation within the van der Waals gaps was determined by high-precision x-ray diffraction analysis which showed a notably higher Fe occupation than in bulk crystals. We thus infer that the higher magnetic ordering temperature results from an increased exchange interaction among the Fe5GeTe2 layers mediated by iron within the gaps between these layers. Our findings establish self-intercalation during epitaxial growth as an efficient mechanism to achieve high-temperature magnetism in a broad class of van der Waals materials.


title: Investigating the Drivers of Electron Temperature Variations in HII Regions with Keck-KCWI and VLT-MUSE

abstract: HII region electron temperatures are a critical ingredient in metallicity determinations and recent observations reveal systematic variations in the temperatures measured using different ions. We present electron temperatures ($T_e$) measured using the optical auroral lines ([NII]$\lambda5756$, [OII]$\lambda\lambda7320,7330$, [SII]$\lambda\lambda4069,4076$, [OIII]$\lambda4363$, and [SIII]$\lambda6312$) for a sample of HII regions in seven nearby galaxies. We use observations from the Physics at High Angular resolution in Nearby Galaxies survey (PHANGS) obtained with integral field spectrographs on Keck (Keck Cosmic Web Imager; KCWI) and the Very Large Telescope (Multi-Unit Spectroscopic Explorer; MUSE). We compare the different $T_e$ measurements with HII region and interstellar medium environmental properties such as electron density, ionization parameter, molecular gas velocity dispersion, and stellar association/cluster mass and age obtained from PHANGS. We find that the temperatures from [OII] and [SII] are likely over-estimated due to the presence of electron density inhomogeneities in HII regions. We observe that differences between [NII] and [SIII] temperatures are weakly correlated with stellar association mass and molecular gas velocity dispersion. We measure high [OIII] temperatures in a subset of regions with high molecular gas velocity dispersion and low ionization parameter, which may be explained by the presence of low-velocity shocks. In agreement with previous studies, the $T_{\rm{e}}$--$T_{\rm{e}}$ between [NII] and [SIII] temperatures have the lowest observed scatter and generally follow predictions from photoionization modeling, which suggests that these tracers reflect HII region temperatures across the various ionization zones better than [OII], [SII], and [OIII].


title: Uniformizing the moduli stacks of global $G$-Shtukas II

abstract: We show that the moduli spaces of bounded global $\mathcal{G}$-Shtukas with pairwise colliding legs admit $p$-adic uniformization isomorphisms by Rapoport-Zink spaces. Here $\mathcal{G}$ is a smooth affine group scheme with connected fibers and reductive generic fiber, i.e. we do not assume it to be parahoric, or even hyperspecial. Moreover, we deduce the Langlands-Rapoport Conjecture over function fields in the case of colliding legs using our uniformization theorem.


title: Powertrain Hybridization for Autonomous Vehicles

abstract: The powertrains of today's hybrid electric vehicles (HEVs) are developed for human drivers and, therefore, may not be the optimum choice for future Autonomous vehicles (AVs), given that AVs can accurately manipulate their velocity profile to avoid unnecessary energy loss. In this work, we closely examine the necessary degree of hybridization for AVs compared to human drivers by deploying real-world urban driving profiles and generating equivalent AV drive cycles in a mixed autonomy scenario. We solve the optimal energy management problem for HEVs with various motor sizes from the automotive market, and demonstrate that while human drivers typically require a motor size of around 30 kW to fully benefit from hybridization, AVs can achieve similar gains with only a 12 kW motor. This greater benefit from a smaller motor size can be attributed to a more optimal torque request, allowing for higher gains from regenerative braking and a more efficient engine operation. Furthermore, We investigate the benefits of velocity smoothing for both traditional cars and HEVs and explore the role of different mechanisms contributing to fuel consumption reduction. Our analysis reveals that velocity smoothing provides greater benefits to HEVs equipped with small motors compared to non-hybrid vehicles and HEVs with larger motors.


title: The Convexity Condition of Density-Functional Theory

abstract: It has long been postulated that within density-functional theory (DFT) the total energy of a finite electronic system is convex with respect to electron count, so that 2 E_v[N_0] <= E_v[N_0 - 1] + E_v[N_0 + 1]. Using the infinite-separation-limit technique, this article proves the convexity condition for any formulation of DFT that is (1) exact for all v-representable densities, (2) size-consistent, and (3) translationally invariant. An analogous result is also proven for one-body reduced density matrix functional theory. While there are known DFT formulations in which the ground state is not always accessible, indicating that convexity does not hold in such cases, this proof nonetheless confirms a stringent constraint on the exact exchange-correlation functional. We also provide sufficient conditions for convexity in approximate DFT, which could aid in the development of density-functional approximations. This result lifts a standing assumption in the proof of the piecewise linearity condition with respect to electron count, which has proven central to understanding the Kohn-Sham band-gap and the exchange-correlation derivative discontinuity of DFT.

categories: physics.chem-ph cond-mat.str-el physics.comp-ph quant-ph


title: LLM-grounded Video Diffusion Models

abstract: Text-conditioned diffusion models have emerged as a promising tool for neural video generation. However, current models still struggle with intricate spatiotemporal prompts and often generate restricted or incorrect motion. To address these limitations, we introduce LLM-grounded Video Diffusion (LVD). Instead of directly generating videos from the text inputs, LVD first leverages a large language model (LLM) to generate dynamic scene layouts based on the text inputs and subsequently uses the generated layouts to guide a diffusion model for video generation. We show that LLMs are able to understand complex spatiotemporal dynamics from text alone and generate layouts that align closely with both the prompts and the object motion patterns typically observed in the real world. We then propose to guide video diffusion models with these layouts by adjusting the attention maps. Our approach is training-free and can be integrated into any video diffusion model that admits classifier guidance. Our results demonstrate that LVD significantly outperforms its base video diffusion model and several strong baseline methods in faithfully generating videos with the desired attributes and motion patterns.


title: The characteristics of LK-99 by Cu$_2$S removal using ammonia solution: A diamagnetic semiconductor

abstract: In this study, we re-evaluated the superconducting properties of LK-99. The LK-99 samples were synthesized using the process proposed by the original Korean team. Additionally, we examined whether the results of the Korean team are related to Cu$_2$S by using ammonia solution (NH$_3$-H$_2$O) to remove Cu$_2$S . Through x-ray diffraction (XRD) analysis, a distinct Cu$_2$S phase was identified in the LK-99 samples. A subsequent treatment using an ammonia solution effectively eliminated this phase. The appearance of blue Cu$^{+2}$ ions in the solution and the elimination of the Cu$_2$S peak in XRD support the conclusion. The magnetic and electrical properties of LK-99 with and without Cu$_2$S postulate that the superconducting-like behavior in LK-99 predominantly arises from a transition in resistivity due to the influence of Cu$_2$S . As such, LK-99 is better classified as a diamagnetic semiconductor than a room-temperature superconductor. The room-temperature superconductors still require further research.


title: L2CEval: Evaluating Language-to-Code Generation Capabilities of Large Language Models

abstract: Recently, large language models (LLMs), especially those that are pretrained on code, have demonstrated strong capabilities in generating programs from natural language inputs in a few-shot or even zero-shot manner. Despite promising results, there is a notable lack of a comprehensive evaluation of these models language-to-code generation capabilities. Existing studies often focus on specific tasks, model architectures, or learning paradigms, leading to a fragmented understanding of the overall landscape. In this work, we present L2CEval, a systematic evaluation of the language-to-code generation capabilities of LLMs on 7 tasks across the domain spectrum of semantic parsing, math reasoning and Python programming, analyzing the factors that potentially affect their performance, such as model size, pretraining data, instruction tuning, and different prompting methods. In addition to assessing model performance, we measure confidence calibration for the models and conduct human evaluations of the output programs. This enables us to identify and analyze the typical failure modes across various tasks and models. L2CEval offers a comprehensive understanding of the capabilities and limitations of LLMs in language-to-code generation. We also release the evaluation framework and all model outputs, hoping to lay the groundwork for further future research in this domain.


title: A Large Language Model Approach to Educational Survey Feedback Analysis

abstract: This paper assesses the potential for the large language models (LLMs) GPT-4 and GPT-3.5 to aid in deriving insight from education feedback surveys. Exploration of LLM use cases in education has focused on teaching and learning, with less exploration of capabilities in education feedback analysis. Survey analysis in education involves goals such as finding gaps in curricula or evaluating teachers, often requiring time-consuming manual processing of textual responses. LLMs have the potential to provide a flexible means of achieving these goals without specialized machine learning models or fine-tuning. We demonstrate a versatile approach to such goals by treating them as sequences of natural language processing (NLP) tasks including classification (multi-label, multi-class, and binary), extraction, thematic analysis, and sentiment analysis, each performed by LLM. We apply these workflows to a real-world dataset of 2500 end-of-course survey comments from biomedical science courses, and evaluate a zero-shot approach (i.e., requiring no examples or labeled training data) across all tasks, reflecting education settings, where labeled data is often scarce. By applying effective prompting practices, we achieve human-level performance on multiple tasks with GPT-4, enabling workflows necessary to achieve typical goals. We also show the potential of inspecting LLMs' chain-of-thought (CoT) reasoning for providing insight that may foster confidence in practice. Moreover, this study features development of a versatile set of classification categories, suitable for various course types (online, hybrid, or in-person) and amenable to customization. Our results suggest that LLMs can be used to derive a range of insights from survey text.


title: SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimation

abstract: Expressive human pose and shape estimation (EHPS) unifies body, hands, and face motion capture with numerous applications. Despite encouraging progress, current state-of-the-art methods still depend largely on a confined set of training datasets. In this work, we investigate scaling up EHPS towards the first generalist foundation model (dubbed SMPLer-X), with up to ViT-Huge as the backbone and training with up to 4.5M instances from diverse data sources. With big data and the large model, SMPLer-X exhibits strong performance across diverse test benchmarks and excellent transferability to even unseen environments. 1) For the data scaling, we perform a systematic investigation on 32 EHPS datasets, including a wide range of scenarios that a model trained on any single dataset cannot handle. More importantly, capitalizing on insights obtained from the extensive benchmarking process, we optimize our training scheme and select datasets that lead to a significant leap in EHPS capabilities. 2) For the model scaling, we take advantage of vision transformers to study the scaling law of model sizes in EHPS. Moreover, our finetuning strategy turn SMPLer-X into specialist models, allowing them to achieve further performance boosts. Notably, our foundation model SMPLer-X consistently delivers state-of-the-art results on seven benchmarks such as AGORA (107.2 mm NMVE), UBody (57.4 mm PVE), EgoBody (63.6 mm PVE), and EHF (62.3 mm PVE without finetuning). Homepage: https://caizhongang.github.io/projects/SMPLer-X/


title: Experimental demonstration of spectral linear dark field control at NASA's high contrast imaging testbeds

abstract: Due to the low flux of exoEarths, long exposure times are required to spectrally characterize them. During these long exposures, the contrast in the dark hole will degrade as the the optical system drifts from its initial DH state. To prevent such contrast drift, a wavefront sensing and control (WFSC) algorithm running in parallel to the science acquisition can stabilize the contrast. However, pairwise probing (PWP) cannot be reused to efficiently stabilize the contrast since it relies on strong temporal modulation of the intensity in the image plane, which would interrupt the science acquisition. The use of small amplitude probes has been demonstrated but requires multiple measurements from each science sub-band to converge. Conversely, spectral linear dark field control (LDFC) takes advantage of the linear relationship between the change in intensity of the post-coronagraph out-of-band image and small changes in wavefront in the science band to preserve the DH region during science exposures. In this paper, we show experimental results that demonstrate spectral LDFC stabilizes the contrast to levels of a few $10^{-9}$ on a Lyot coronagraph testbed which is housed in a vacuum chamber. Promising results show that spectral LDFC is able to correct for disturbances that degrade the contrast by more than 100$\times$. To our knowledge, this is the first experimental demonstration of spectral LDFC and the first demonstration of spatial or spectral LDFC on a vacuum coronagraph testbed and at contrast levels less than $10^{-8}$.


title: Multi-task View Synthesis with Neural Radiance Fields

abstract: Multi-task visual learning is a critical aspect of computer vision. Current research, however, predominantly concentrates on the multi-task dense prediction setting, which overlooks the intrinsic 3D world and its multi-view consistent structures, and lacks the capability for versatile imagination. In response to these limitations, we present a novel problem setting -- multi-task view synthesis (MTVS), which reinterprets multi-task prediction as a set of novel-view synthesis tasks for multiple scene properties, including RGB. To tackle the MTVS problem, we propose MuvieNeRF, a framework that incorporates both multi-task and cross-view knowledge to simultaneously synthesize multiple scene properties. MuvieNeRF integrates two key modules, the Cross-Task Attention (CTA) and Cross-View Attention (CVA) modules, enabling the efficient use of information across multiple views and tasks. Extensive evaluation on both synthetic and realistic benchmarks demonstrates that MuvieNeRF is capable of simultaneously synthesizing different scene properties with promising visual quality, even outperforming conventional discriminative models in various settings. Notably, we show that MuvieNeRF exhibits universal applicability across a range of NeRF backbones. Our code is available at https://github.com/zsh2000/MuvieNeRF.


title: Are Odd Radio Circles virial shocks around massive galaxies? Implications for cosmic-ray diffusion in the circumgalactic medium

abstract: Recently, a new population of circular radio ($\sim$GHz) objects have been discovered at high Galactic latitudes, called the Odd Radio Circles (ORCs). A fraction of the ORCs encircles massive galaxies in the sky with stellar mass $\sim 10^{11}\, M_\odot$ situated at $z=0.2$-$0.6$, suggesting a possible physical connection. In this work, we explore the possibility that these radio circles originate from the accretion shocks/virial shocks around massive ($\gtrsim10^{13}\, M_\odot$) dark matter halo at $z\sim0.5$. We found that the radio flux density of the emitting shell is marginally consistent with the ORCs. We also find that pure advection of electrons from the shock results in a radio-emitting shell that is considerably narrower than the observed one due to strong inverse-Compton cooling of electrons. Instead, we show that the diffusion of cosmic-ray (CR) electrons plays a significant role in increasing the width of the shell. We infer a diffusion coefficient, $D_{\rm cr} \sim 10^{30}\ {\rm cm^2\,s^{-1}}$, consistent with the values expected for low-density circumgalactic medium (CGM). If ORCs indeed trace virial shocks, then our derived CR diffusion coefficient represents one of the few estimations available for the low-density CGM. Finally, we show that the apparent discrepancy between ORC and halo number density can be mitigated by considering an incomplete halo virialization and the limited radiation efficiency of shocks. This study, therefore, opens up new avenues to probe such shocks and non-thermal particle acceleration within them. Furthermore, our results suggest that low-mass galaxies ($\lesssim 10^{13}\, M_\odot$) may not show ORCs due to their significantly lower radio surface brightness.


title: ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving

abstract: Large language models have made significant progress in various language tasks, yet they still struggle with complex mathematics. In this paper, we propose ToRA a series of Tool-integrated Reasoning Agents designed to solve challenging mathematical problems by seamlessly integrating natural language reasoning with the utilization of external tools (e.g., computation libraries and symbolic solvers), thereby amalgamating the analytical prowess of language and the computational efficiency of tools. To train ToRA, we curate interactive tool-use trajectories on mathematical datasets, apply imitation learning on the annotations, and propose output space shaping to further refine models' reasoning behavior. As a result, ToRA models significantly outperform open-source models on 10 mathematical reasoning datasets across all scales with 13%-19% absolute improvements on average. Notably, ToRA-7B reaches 44.6% on the competition-level dataset MATH, surpassing the best open-source model WizardMath-70B by 22% absolute. ToRA-Code-34B is also the first open-source model that achieves an accuracy exceeding 50% on MATH, which significantly outperforms GPT-4's CoT result, and is competitive with GPT-4 solving problems with programs. Additionally, we conduct a comprehensive analysis of the benefits and remaining challenges of tool interaction for mathematical reasoning, providing valuable insights for future research.


title: Efficient Streaming Language Models with Attention Sinks

abstract: Deploying Large Language Models (LLMs) in streaming applications such as multi-round dialogue, where long interactions are expected, is urgently needed but poses two major challenges. Firstly, during the decoding stage, caching previous tokens' Key and Value states (KV) consumes extensive memory. Secondly, popular LLMs cannot generalize to longer texts than the training sequence length. Window attention, where only the most recent KVs are cached, is a natural approach -- but we show that it fails when the text length surpasses the cache size. We observe an interesting phenomenon, namely attention sink, that keeping the KV of initial tokens will largely recover the performance of window attention. In this paper, we first demonstrate that the emergence of attention sink is due to the strong attention scores towards initial tokens as a "sink" even if they are not semantically important. Based on the above analysis, we introduce StreamingLLM, an efficient framework that enables LLMs trained with a finite length attention window to generalize to infinite sequence lengths without any fine-tuning. We show that StreamingLLM can enable Llama-2, MPT, Falcon, and Pythia to perform stable and efficient language modeling with up to 4 million tokens and more. In addition, we discover that adding a placeholder token as a dedicated attention sink during pre-training can further improve streaming deployment. In streaming settings, StreamingLLM outperforms the sliding window recomputation baseline by up to 22.2x speedup. Code and datasets are provided at https://github.com/mit-han-lab/streaming-llm.


title: AsaPy: A Python Library for Aerospace Simulation Analysis

abstract: AsaPy is a custom-made Python library designed to simplify and optimize the analysis of aerospace simulation data. Instead of introducing new methodologies, it excels in combining various established techniques, creating a unified, specialized platform. It offers a range of features, including the design of experiment methods, statistical analysis techniques, machine learning algorithms, and data visualization tools. AsaPy's flexibility and customizability make it a viable solution for engineers and researchers who need to quickly gain insights into aerospace simulations. AsaPy is built on top of popular scientific computing libraries, ensuring high performance and scalability. In this work, we provide an overview of the key features and capabilities of AsaPy, followed by an exposition of its architecture and demonstrations of its effectiveness through some use cases applied in military operational simulations. We also evaluate how other simulation tools deal with data science, highlighting AsaPy's strengths and advantages. Finally, we discuss potential use cases and applications of AsaPy and outline future directions for the development and improvement of the library.


title: The concept of probability, crisis in statistics, and the unbearable lightness of Bayesing

abstract: Education in statistics, the application of statistics in scientific research, and statistics itself as a scientific discipline are in crisis. Within science, the main cause of the crisis is the insufficiently clarified concept of probability. This article aims to separate the concept of probability which is scientifically based from other concepts that do not have this characteristic. The scientifically based concept of probability is Kolmogorovs concept of probability models together with the conditions of their applicability. Bayesian statistics is based on the subjective concept of probability, and as such can only have a heuristic value in searching for the truth, but it cannot and must not replace the truth. The way out of the crisis should take Kolmogorov and Bayesian analysis as elements, each of which has a well-defined and limited use. Only together with qualitative analysis and other types of quantitative analysis, and combined with experiments, they can contribute to reaching correct conclusions.


title: Derivation of a 2D PCCU-AENO method for nonconservative problems. Theory, Method and theoretical arguments

abstract: In this paper, we introduce a methodology to design genuinely two-dimensional (2D) secondorder path-conservative central-upwind (PCCU) schemes. The scheme studies dam-break with high sediment concentration over abrupt moving topography quickly spatially variable even in the presence of resonance. This study is possible via a 2D sediment transport model (including arbitrarily sloping sediment beds and associated energy and entropy) in new generalized Shallow Water equations derived with associated energy and entropy in this work. We establish an existence theorem of global weak solutions. We show the convergence of a sequence of solutions of the proposed model. The second-order accuracy of the PCCU scheme is achieved using a new extension AENO (Averaging Essentially Non-Oscillatory) reconstruction developed in the 2D version of this work. We prove by rigorous demonstrations that the derived 2D scheme on structured meshes is well-balanced and positivity-preserving. Several tests are made to show the ability and superb performance of the proposed numerical modeling. The results obtained are compared with those existing in the literature and with experimental data. The current modeling improves some recent results in sediment transport and shows a good ability to simulate sediment transport in large-range environments.


title: Statistics for Machine Learning with Mathematica Applications

abstract: In recent years, the field of statistics has experienced a surge in interest and application, largely due to significant advances in computer technology. This progress has led to remarkable developments in statistics methods and algorithms, enabling their widespread adoption across various disciplines. Key areas benefiting from these advancements include machine learning, economics, finance, geophysics, molecular modeling, computational systems biology, operations research, and engineering. For example, in machine learning, statistics forms the foundation for algorithms used in regression, classification, clustering, and deep learning to analyze vast datasets and make predictions. Mathematica, among other tools, has played a significant role in enabling the integration of statistics and computer technology, facilitating deeper exploration of data-driven insights and groundbreaking discoveries across diverse domains. With a rich library of functions, Mathematica allows users to calculate measures of central tendency, dispersion, and correlation, as well as perform hypothesis testing and estimation. Moreover, it supports probability distributions, making simulations and probabilistic modeling tasks more accessible. This monograph presents the main theorems in mathematical statistics, ranging from basic descriptive statistics to sophisticated inferential techniques. In addition, we have created, more than 200 manipulates cover different scenarios in statistics, more than 500 light Mathematica codes (examples) and 25 programs (procedures) that follow the principles of testing hypotheses and estimation theory. The code will run as-is with no code from prior algorithms or third parties required beyond the installation of Mathematica.


title: Automated machine vision control system for technological nodes assembly process

abstract: The paper discusses the prerequisites for the creation, technical solutions and implementation of an automated control system for the assembly of a small spacecraft. Both the hardware and software implementation of the system that provides control and logging of the assembly process of individual units at various workplaces are analyzed. The article presents solutions to reduce the requirements for equipment used to control the assembly technology, in particular, to use cameras with a lower resolution, through the use of special algorithms for the formation and processing of technological marks. A tool is presented that allows you to control the tightening torques of threaded connections and limit the tightening torque according to a given algorithm with wireless control. The developed system provides the functions of not only control, but also logging of the technological process, which can be useful in the future when creating a digital twin of the product.


title: Pb$_9$Cu(PO$_4$)$_6$O is a charge-transfer semiconductor

abstract: By means of density functional theory and constrained random phase approximation we analyze the bandstructure of Pb$_9$Cu(PO$_4$)$_6$O (named LK-99). Our data show that the lead-phosphate apatite LK-99 in the proposed Cu-doped structure is a semiconductor with predominant charge-transfer nature, a result incompatible with a superconducting behaviour. In order to understand the interesting electronic and magnetic properties of this compound, it will be necessary to study the actual response to doping, the possibility of alternative structural and stoichiometric (dis)orders and to clarify the magnetic interactions as well as their impact on the electronic structure.


title: Semicoductor-metallic hybrid nano-disk laser

abstract: In this research, semiconductor-metallic hybrid nano-disk laser based on InGaAsP multi quantum wells (MQWs) or InGaAs bulk material membranes were designed, fabricated and characterized. The quality factors of surface-plasmon-polariton (SPP) modes can be improved by introducing a transparent dielectric shield layer between the metallic cap and the gain material. The InGaAsP MQWs based semiconductor-metallic hybrid nano-laser can surpport SPP mode lasing at room temperature. With diameter of 600 nm, the lasing mode is TM-like SPP mode. Under high pumping, for nano-laser, the quantized levels in the wells and the barrier are populated. This behavior supported multi-mode lasing. The InGaAs bulk material based semiconductor-metallic hybrid nano-laser perform that the carrier density saturated the energy band and populated the higher band as well. The nano-laser also supports multi-mode lasing at room temperature. At loe temperature of 77K, the nano-laser with 400 nm diameter can support TE-like SPP mode lasing.


title: Dynamic Multimodal Locomotion: A Quick Overview of Hardware and Control

abstract: Bipedal robots are a fascinating and advanced category of robots designed to mimic human form and locomotion. The development of the bipedal robots is a significant milestone in robotics. However, even the most advanced bipedal robots are susceptible to changes in terrain, obstacle negotiation, payload, and weight distribution, and the ability to recover after stumbles. These problems can be circumvented by introducing thrusters. Thrusters will allow the robot to stabilize on various uneven terrain. The robot can easily avoid obstacles and will be able to recover after stumbling. Harpy is a bipedal robot that has 6 joints and 2 thrusters and serves as a hardware platform for implementing advanced control algorithms. This thesis explores manufacturing harpy hardware such that the overall system can be lightweight and strong. Also, it goes through simulation results to show thruster-assisted walking, and at last, it shows firmware and communication network development which is implemented on actual hardware. vii


title: Dataset Generation for Drone Optimal Placement Using Machine Learning

abstract: Unmanned aerial vehicle (UAV), or drone is increasingly becoming a promising tool in communication system. This report explains the generation details of a dataset which will be used to designing an algorithm for the optimal placement of UAVs in the drone-assisted vehicular network (DAVN). The goal is to improve the drones' communication and energy efficiency after our previous work. The report is organized as followed: the first section is devoted to the delay analysis of the vehicle requests in the DAVN using queuing theory; the second part of the report models the energy consumption of the drones while the third section explains the simulation scenario and dataset features. The notations and terminologies used in this report are summarized in the last section.


title: Artificial Empathy Classification: A Survey of Deep Learning Techniques, Datasets, and Evaluation Scales

abstract: From the last decade, researchers in the field of machine learning (ML) and assistive developmental robotics (ADR) have taken an interest in artificial empathy (AE) as a possible future paradigm for human-robot interaction (HRI). Humans learn empathy since birth, therefore, it is challenging to instill this sense in robots and intelligent machines. Nevertheless, by training over a vast amount of data and time, imitating empathy, to a certain extent, can be possible for robots. Training techniques for AE, along with findings from the field of empathetic AI research, are ever-evolving. The standard workflow for artificial empathy consists of three stages: 1) Emotion Recognition (ER) using the retrieved features from video or textual data, 2) analyzing the perceived emotion or degree of empathy to choose the best course of action, and 3) carrying out a response action. Recent studies that show AE being used with virtual agents or robots often include Deep Learning (DL) techniques. For instance, models like VGGFace are used to conduct ER. Semi-supervised models like Autoencoders generate the corresponding emotional states and behavioral responses. However, there has not been any study that presents an independent approach for evaluating AE, or the degree to which a reaction was empathetic. This paper aims to investigate and evaluate existing works for measuring and evaluating empathy, as well as the datasets that have been collected and used so far. Our goal is to highlight and facilitate the use of state-of-the-art methods in the area of AE by comparing their performance. This will aid researchers in the area of AE in selecting their approaches with precision.


title: Joint Self-supervised Depth and Optical Flow Estimation towards Dynamic Objects

abstract: Significant attention has been attracted to deep learning-based depth estimates. Dynamic objects become the most hard problems in inter-frame-supervised depth estimates due to the uncertainty in adjacent frames. Thus, integrating optical flow information with depth estimation is a feasible solution, as the optical flow is an essential motion representation. In this work, we construct a joint inter-frame-supervised depth and optical flow estimation framework, which predicts depths in various motions by minimizing pixel wrap errors in bilateral photometric re-projections and optical vectors. For motion segmentation, we adaptively segment the preliminary estimated optical flow map with large areas of connectivity. In self-supervised depth estimation, different motion regions are predicted independently and then composite into a complete depth. Further, the pose and depth estimations re-synthesize the optical flow maps, serving to compute reconstruction errors with the preliminary predictions. Our proposed joint depth and optical flow estimation outperforms existing depth estimators on the KITTI Depth dataset, both with and without Cityscapes pretraining. Additionally, our optical flow results demonstrate competitive performance on the KITTI Flow 2015 dataset.


title: Operator-free Equilibrium on the Sphere

abstract: We propose a generalized minimum discrepancy, which derives from Legendre's ODE and spherical harmonic theoretics to provide a new criterion of equidistributed pointsets on the sphere. A continuous and derivative kernel in terms of elementary functions is established to simplify the computation of the generalized minimum discrepancy. We consider the deterministic point generated from Pycke's statistics to integrate a Franke function for the sphere and investigate the discrepancies of points systems embedding with different kernels. Quantitive experiments are conducted and the results are analyzed. Our deduced model can explore latent point systems, that have the minimum discrepancy without the involvement of pseudodifferential operators and Beltrami operators, by the use of derivatives. Compared to the random point generated from the Monte Carlo method, only a few points generated by our method are required to approximate the target in arbitrary dimensions.


title: Adaptive Communications in Collaborative Perception with Domain Alignment for Autonomous Driving

abstract: Collaborative perception among multiple connected and autonomous vehicles can greatly enhance perceptive capabilities by allowing vehicles to exchange supplementary information via communications. Despite advances in previous approaches, challenges still remain due to channel variations and data heterogeneity among collaborative vehicles. To address these issues, we propose ACC-DA, a channel-aware collaborative perception framework to dynamically adjust the communication graph and minimize the average transmission delay while mitigating the side effects from the data heterogeneity. Our novelties lie in three aspects. We first design a transmission delay minimization method, which can construct the communication graph and minimize the transmission delay according to different channel information state. We then propose an adaptive data reconstruction mechanism, which can dynamically adjust the rate-distortion trade-off to enhance perception efficiency. Moreover, it minimizes the temporal redundancy during data transmissions. Finally, we conceive a domain alignment scheme to align the data distribution from different vehicles, which can mitigate the domain gap between different vehicles and improve the performance of the target task. Comprehensive experiments demonstrate the effectiveness of our method in comparison to the existing state-of-the-art works.


title: Fewer-token Neural Speech Codec with Time-invariant Codes

abstract: Language model based text-to-speech (TTS) models, like VALL-E, have gained attention for their outstanding in-context learning capability in zero-shot scenarios. Neural speech codec is a critical component of these models, which can convert speech into discrete token representations. However, excessive token sequences from the codec may negatively affect prediction accuracy and restrict the progression of Language model based TTS models. To address this issue, this paper proposes a novel neural speech codec with time-invariant codes named TiCodec. By encoding and quantizing time-invariant information into a separate code, TiCodec can reduce the amount of frame-level information that needs encoding, effectively decreasing the number of tokens as codes of speech. Furthermore, this paper introduces a time-invariant encoding consistency loss to enhance the consistency of time-invariant code within an utterance and force it to capture more global information, which can benefit the zero-shot TTS task. Experimental results demonstrate that TiCodec can not only enhance the quality of reconstruction speech with fewer tokens but also increase the similarity and naturalness, as well as reduce the word error rate of the synthesized speech by the TTS model.


title: Semantic Communication with Probability Graph: A Joint Communication and Computation Design

abstract: In this paper, we present a probability graph-based semantic information compression system for scenarios where the base station (BS) and the user share common background knowledge. We employ probability graphs to represent the shared knowledge between the communicating parties. During the transmission of specific text data, the BS first extracts semantic information from the text, which is represented by a knowledge graph. Subsequently, the BS omits certain relational information based on the shared probability graph to reduce the data size. Upon receiving the compressed semantic data, the user can automatically restore missing information using the shared probability graph and predefined rules. This approach brings additional computational resource consumption while effectively reducing communication resource consumption. Considering the limitations of wireless resources, we address the problem of joint communication and computation resource allocation design, aiming at minimizing the total communication and computation energy consumption of the network while adhering to latency, transmit power, and semantic constraints. Simulation results demonstrate the effectiveness of the proposed system.