title: Adaptive Compression-Aware Split Learning and Inference for Enhanced Network Efficiency

abstract: The growing number of AI-driven applications in mobile devices has led to solutions that integrate deep learning models with the available edge-cloud resources. Due to multiple benefits such as reduction in on-device energy consumption, improved latency, improved network usage, and certain privacy improvements, split learning, where deep learning models are split away from the mobile device and computed in a distributed manner, has become an extensively explored topic. Incorporating compression-aware methods (where learning adapts to compression level of the communicated data) has made split learning even more advantageous. This method could even offer a viable alternative to traditional methods, such as federated learning techniques. In this work, we develop an adaptive compression-aware split learning method ('deprune') to improve and train deep learning models so that they are much more network-efficient, which would make them ideal to deploy in weaker devices with the help of edge-cloud resources. This method is also extended ('prune') to very quickly train deep learning models through a transfer learning approach, which trades off little accuracy for much more network-efficient inference abilities. We show that the 'deprune' method can reduce network usage by 4x when compared with a split-learning approach (that does not use our method) without loss of accuracy, while also improving accuracy over compression-aware split-learning by 4 percent. Lastly, we show that the 'prune' method can reduce the training time for certain models by up to 6x without affecting the accuracy when compared against a compression-aware split-learning approach.


title: Generating Pragmatic Examples to Train Neural Program Synthesizers

abstract: Programming-by-example is the task of synthesizing a program that is consistent with a set of user-provided input-output examples. As examples are often an under-specification of one's intent, a good synthesizer must choose the intended program from the many that are consistent with the given set of examples. Prior work frames program synthesis as a cooperative game between a listener (that synthesizes programs) and a speaker (a user choosing examples), and shows that models of computational pragmatic inference are effective in choosing the user intended programs. However, these models require counterfactual reasoning over a large set of programs and examples, which is infeasible in realistic program spaces. In this paper, we propose a novel way to amortize this search with neural networks. We sample pairs of programs and examples via self-play between listener and speaker models, and use pragmatic inference to choose informative training examples from this sample.We then use the informative dataset to train models to improve the synthesizer's ability to disambiguate user-provided examples without human supervision. We validate our method on the challenging task of synthesizing regular expressions from example strings, and find that our method (1) outperforms models trained without choosing pragmatic examples by 23% (a 51% relative increase) (2) matches the performance of supervised learning on a dataset of pragmatic examples provided by humans, despite using no human data in training.


title: Efficiently Adapting Pretrained Language Models To New Languages

abstract: Recent large language models (LLM) exhibit sub-optimal performance on low-resource languages, as the training data of these models is usually dominated by English and other high-resource languages. Furthermore, it is challenging to train models for low-resource languages, especially from scratch, due to a lack of high quality training data. Adapting pretrained LLMs reduces the need for data in the new language while also providing cross lingual transfer capabilities. However, naively adapting to new languages leads to catastrophic forgetting and poor tokenizer efficiency. In this work, we study how to efficiently adapt any existing pretrained LLM to a new language without running into these issues. In particular, we improve the encoding efficiency of the tokenizer by adding new tokens from the target language and study the data mixing recipe to mitigate forgetting. Our experiments on adapting an English LLM to Hungarian and Thai show that our recipe can reach better performance than open source models on the target language, with minimal regressions on English.


title: Optimal simulation-based Bayesian decisions

abstract: We present a framework for the efficient computation of optimal Bayesian decisions under intractable likelihoods, by learning a surrogate model for the expected utility (or its distribution) as a function of the action and data spaces. We leverage recent advances in simulation-based inference and Bayesian optimization to develop active learning schemes to choose where in parameter and action spaces to simulate. This allows us to learn the optimal action in as few simulations as possible. The resulting framework is extremely simulation efficient, typically requiring fewer model calls than the associated posterior inference task alone, and a factor of $100-1000$ more efficient than Monte-Carlo based methods. Our framework opens up new capabilities for performing Bayesian decision making, particularly in the previously challenging regime where likelihoods are intractable, and simulations expensive.


title: Advancing Algorithmic Trading: A Multi-Technique Enhancement of Deep Q-Network Models

abstract: This study enhances a Deep Q-Network (DQN) trading model by incorporating advanced techniques like Prioritized Experience Replay, Regularized Q-Learning, Noisy Networks, Dueling, and Double DQN. Extensive tests on assets like BTC/USD and AAPL demonstrate superior performance compared to the original model, with marked increases in returns and Sharpe Ratio, indicating improved risk-adjusted rewards. Notably, convolutional neural network (CNN) architectures, both 1D and 2D, significantly boost returns, suggesting their effectiveness in market trend analysis. Across instruments, these enhancements have yielded stable and high gains, eclipsing the baseline and highlighting the potential of CNNs in trading systems. The study suggests that applying sophisticated deep learning within reinforcement learning can greatly enhance automated trading, urging further exploration into advanced methods for broader financial applicability. The findings advocate for the continued evolution of AI in finance.


title: Flexibility of Integrated Power and Gas Systems: Modeling and Solution Choices Matter

abstract: Due to their slow gas flow dynamics, natural gas pipelines function as short-term storage, the so-called \textit{linepack}. By efficiently utilizing linepack, the natural gas system can provide flexibility to the power system through the flexible operation of gas-fired power plants. This requires accurately representing the gas flow physics governed by partial differential equations. Although several modeling and solution choices have been proposed in the literature, their impact on the flexibility provision of gas networks to power systems has not been thoroughly analyzed and compared. This paper bridges this gap by first developing a unified framework. We harmonize existing approaches and demonstrate their derivation from and application to the partial differential equations. Secondly, based on the proposed framework, we numerically analyze the implications of various modeling and solution choices on the flexibility provision from gas networks to power systems. One key conclusion is that relaxation-based approaches allow charging and discharging the linepack at physically infeasible high rates, ultimately overestimating the flexibility.


title: Hydration of biologically relevant tetramethylammonium cation by neutron scattering and molecular dynamics

abstract: Neutron scattering and molecular dynamics studies were performed on a concentrated aqueous tetramethylammonium (TMA) chloride solution to gain insight into the hydration shell structure of TMA, which is relevant for understanding its behavior in biological contexts of, e.g., properties of phospholipid membrane headgroups or interactions between DNA and histones. Specifically, neutron diffraction with isotopic substitution experiments were performed on TMA and water hydrogens to extract the specific correlation between hydrogens in TMA ($\mathrm{H_{TMA}}$) and hydrogens in water ($\mathrm{H_{W}}$). Classical molecular dynamics simulations were performed to help interpret the experimental neutron scattering data. Comparison of the hydration structure and simulated neutron signals obtained with various force field flavors (e.g. overall charge, charge distribution, polarity of the CH bonds and geometry) allowed us to gain insight into how sensitive the TMA hydration structure is to such changes and how much the neutron signal can capture them. We show that certain aspects of the hydration, such as the correlation of the hydrogen on TMA to hydrogen on water, showed little dependence on the force field. In contrast, other correlations, such as the ion-ion interactions, showed more marked changes. Strikingly, the neutron scattering signal cannot discriminate between different hydration patterns. Finally, ab initio molecular dynamics was used to examine the three-dimensional hydration structure and thus to benchmark force field simulations. Overall, while neutron scattering has been previously successfully used to improve force fields, in the particular case of TMA we show that it has only limited value to fully determine the hydration structure, with other techniques such as ab initio MD being of a significant help.


title: Bridging the Digital Divide: Performance Variation across Socio-Economic Factors in Vision-Language Models

abstract: Despite the impressive performance of current AI models reported across various tasks, performance reports often do not include evaluations of how these models perform on the specific groups that will be impacted by these technologies. Among the minority groups under-represented in AI, data from low-income households are often overlooked in data collection and model evaluation. We evaluate the performance of a state-of-the-art vision-language model (CLIP) on a geo-diverse dataset containing household images associated with different income values (Dollar Street) and show that performance inequality exists among households of different income levels. Our results indicate that performance for the poorer groups is consistently lower than the wealthier groups across various topics and countries. We highlight insights that can help mitigate these issues and propose actionable steps for economic-level inclusive AI development. Code is available at https://github.com/MichiganNLP/Bridging_the_Digital_Divide.


title: A note on a Vlasov-Fokker-Planck equation with non-symmetric interaction

abstract: In the recent [3], Cesbron and Herda study a Vlasov-Fokker-Planck (VFP) equation with non-symmetric interaction, introduced in physics to model the distribution of electrons in a synchrotron particle accelerator. We make four remarks in view of their work: first, it is noticed in [3] that the free energy classically considered for the (symmetric) VFP equation is not a Lyapunov function in the non-symmetric case, and we will show however that this is still the case for a suitable definition of the free energy (with no explicit expression in general). Second, when the interaction is sufficiently small (in $W^{1,\infty}$), it is proven in [3] that the equation has a unique stationary solution which is locally attractive; in this spirit, we will see that, when the interaction force is Lipschitz with a sufficiently small constant, the convergence is global. Third, we also briefly discuss the mean-field interacting particle system corresponding to the VFP equation which, interestingly, is a non-equilibrium Langevin process. Finally, we will see that, in the small interaction regime, a suitable (explicit) non-linear Fisher information is contracted at constant rate, similarly to the situation of Wasserstein gradient flows for convex functionals (although here the dynamics is not a gradient flow).


title: Enabling Automated Integration Testing of Smart Farming Applications via Digital Twin Prototypes

abstract: Industry 4.0 represents a major technological shift that has the potential to transform the manufacturing industry, making it more efficient, productive, and sustainable. Smart farming is a concept that involves the use of advanced technologies to improve the efficiency and sustainability of agricultural practices. Industry 4.0 and smart farming are closely related, as many of the technologies used in smart farming are also used in Industry 4.0. Digital twins have the potential for cost-effective software development of such applications. With our Digital Twin Prototype approach, all sensor interfaces are integrated into the development process, and their inputs and outputs of the emulated hardware match those of the real hardware. The emulators respond to the same commands and return identically formatted data packages as their real counterparts, making the Digital Twin Prototype a valid source of a digital shadow, i.e. the Digital Twin Prototype is a prototype of the physical twin and can replace it for automated testing of the digital twin software. In this paper, we present a case study for employing our Digital Twin Prototype approach to automated testing of software for improving the making of silage with a smart farming application. Besides automated testing with continuous integration, we also discuss continuous deployment of modular Docker containers in this context.


title: Mott Transition and Volume Law Entanglement with Neural Quantum States

abstract: The interplay between delocalisation and repulsive interactions can cause electronic systems to undergo a Mott transition between a metal and an insulator. Here we use neural network hidden fermion determinantal states (HFDS) to uncover this transition in the disordered, fully-connected Hubbard model. Whilst dynamical mean-field theory (DMFT) provides exact solutions to physical observables of the model in the thermodynamic limit, our method allows us to directly access the wavefunction for finite system sizes well beyond the reach of exact diagonalisation. We directly benchmark our results against state-of-the-art calculations obtained using a Matrix Product State (MPS) ansatz. We demonstrate how HFDS is able to obtain more accurate results in the metallic regime and in the vicinity of the transition, with the volume law of entanglement exhibited by the system being prohibitive to the MPS ansatz. We use the HFDS method to calculate the amplitudes of the wavefunction, the energy and double occupancy, the quasi-particle weight and the energy gap, hence providing novel insights into this model and the nature of the transition. Our work paves the way for the study of strongly correlated electron systems with neural quantum states.


title: A quotient framework for single-input pole placement and associated algorithms

abstract: Single-input eigenvalue assignment problem (SEVAS) for dense (non-sparse) weakly controllable pairs A,B using Ackermann's formula is revisited. Factorizations are presented that are interpreted using quotient (factor) vector spaces. Depending on the representations chosen for the equivalence class (given as specific projections by real orthogonal matrices), the numerical behavior of pole placement scheme can be enhanced. One version operates by placing one pole at a time (with complex conjugate poles grouped together to avoid complex arithmetic). Another version operates with the coefficients of the characteristic polynomial directly. The latter version uses orthogoanl real matrices. In both cases, there are no constraint on the number of identical poles. A version of the algorithm uses only ring arithmetic. The algorithms are compared with numerically stable algorithms that appeared in the literature, such as the Miminis-Paige algorithm or the Varga pole shifting method. In case of real distinct eigenvalues to be placed, a geometrical interpretation as the interesection of affine hyperplanes provides the value of the gain vector, which seems a novel interpretation.


title: On points avoiding measures

abstract: We say that an element $x$ of a topological space $X$ avoids measures if for every Borel measure $\mu$ on $X$ if $\mu(\{x\})=0$, then there is an open $U\ni x$ such that $\mu(U)=0$. The negation of this property can viewed as a local version of the property of supporting a strictly positive measure. We study points avoiding measures in the general setting as well as in the context of $\omega^\ast$, the remainder of Stone-\v{C}ech compactification of $\omega$.


title: Single-Atom Control of Arsenic Incorporation in Silicon for High-Yield Artificial Lattice Fabrication

abstract: Artificial lattices constructed from individual dopant atoms within a semiconductor crystal hold promise to provide novel materials with tailored electronic, magnetic, and optical properties. These custom engineered lattices are anticipated to enable new, fundamental discoveries in condensed matter physics and lead to the creation of new semiconductor technologies including analog quantum simulators and universal solid-state quantum computers. In this work, we report precise and repeatable, substitutional incorporation of single arsenic atoms into a silicon lattice. We employ a combination of scanning tunnelling microscopy hydrogen resist lithography and a detailed statistical exploration of the chemistry of arsine on the hydrogen terminated silicon (001) surface, to show that single arsenic dopants can be deterministically placed within four silicon lattice sites and incorporated with 97$\pm$2% yield. These findings bring us closer to the ultimate frontier in semiconductor technology: the deterministic assembly of atomically precise dopant and qubit arrays at arbitrarily large scales.


title: A short computation of the Rouquier dimension for a cycle of projective lines

abstract: Given a dg category $\mathcal C$, we introduce a new class of objects (weakly product bimodules) in $\mathcal C^{op}\otimes \mathcal C$ generalizing product bimodules. We show that the minimal generation time of the diagonal by weakly product bimodules provides an upper bound for the Rouquier dimension of $\mathcal C$. As an application, we give a purely algebro-geometric proof of a result of Burban and Drozd that the Rouquier dimension of the derived category of coherent sheaves on an $n$-cycle of projective lines is one. Our approach explicitly gives the generator realizing the minimal generation time.


title: Deep Natural Language Feature Learning for Interpretable Prediction

abstract: We propose a general method to break down a main complex task into a set of intermediary easier sub-tasks, which are formulated in natural language as binary questions related to the final target task. Our method allows for representing each example by a vector consisting of the answers to these questions. We call this representation Natural Language Learned Features (NLLF). NLLF is generated by a small transformer language model (e.g., BERT) that has been trained in a Natural Language Inference (NLI) fashion, using weak labels automatically obtained from a Large Language Model (LLM). We show that the LLM normally struggles for the main task using in-context learning, but can handle these easiest subtasks and produce useful weak labels to train a BERT. The NLI-like training of the BERT allows for tackling zero-shot inference with any binary question, and not necessarily the ones seen during the training. We show that this NLLF vector not only helps to reach better performances by enhancing any classifier, but that it can be used as input of an easy-to-interpret machine learning model like a decision tree. This decision tree is interpretable but also reaches high performances, surpassing those of a pre-trained transformer in some cases.We have successfully applied this method to two completely different tasks: detecting incoherence in students' answers to open-ended mathematics exam questions, and screening abstracts for a systematic literature review of scientific papers on climate change and agroecology.


title: 4x2 Hot electron bolometer mixer arrays for detection at 1.46, 1.9 and 4.7 THz for a balloon borne terahertz observatory

abstract: We have demonstrated three 4x2 hot electron bolometer (HEB) mixer arrays for operation at local oscillator (LO) frequencies of 1.46, 1.9 and 4.7 THz, respectively. They consist of spiral antenna coupled NbN HEB mixers combined with elliptical lenses. These are to date the highest pixel count arrays using a quasi-optical coupling scheme at supra-THz frequencies. At 1.4 THz, we measured an average double sideband mixer noise temperature of 330 K, a mixer conversion loss of 5.7 dB, and an optimum LO power of 210 nW. The array at 1.9 THz has an average mixer noise temperature of 420K, a conversion loss of 6.9 dB, and an optimum LO power of 190 nW. For the array at 4.7 THz, we obtained an average mixer noise temperature of 700 K, a conversion loss of 9.7 dB, and an optimum LO power of 240 nW. We found the arrays to be uniform regarding the mixer noise temperature with a standard deviation of 3-4%, the conversion loss with a standard deviation of 7-10%, and optimum LO power with a standard deviation of 5-6%. The noise bandwidth was also measured, being 3.5 GHz for the three arrays. These performances are comparable to previously reported values in the literature for single pixels and also other detector arrays. Our arrays meet the requirements of the Galactic/Extra-Galactic ULDB Spectroscopic Terahertz Observatory (GUSTO), a NASA balloon borne observatory, and are therefore scheduled to fly as part of the payload, which is expected to be launched in December 2023.


title: Step and Smooth Decompositions as Topological Clustering

abstract: We investigate a class of recovery problems for which observations are a noisy combination of continuous and step functions. These problems can be seen as non-injective instances of non-linear ICA with direct applications to image decontamination for magnetic resonance imaging. Alternately, the problem can be viewed as clustering in the presence of structured (smooth) contaminant. We show that a global topological property (graph connectivity) interacts with a local property (the degree of smoothness of the continuous component) to determine conditions under which the components are identifiable. Additionally, a practical estimation algorithm is provided for the case when the contaminant lies in a reproducing kernel Hilbert space of continuous functions. Algorithm effectiveness is demonstrated through a series of simulations and real-world studies.


title: Confinement induced three-dimensional trajectories of microswimmers in rectangular channels

abstract: We study the trajectories of a model microorganism inside three-dimensional channels with square and rectangular cross-sections. Using (i) numerical simulations based on lattice-Boltzmann method, and (ii) analytical expressions using far-field hydrodynamic approximations and method of images we systematically investigate the role of the strength and finite-size of the squirmer, confinement dimensions, and initial conditions in determining the three dimensional trajectories of microswimmers. Our results indicate that the hydrodynamic interactions with the confining walls of the channel significantly affect the swimming speed and trajectory of the model microswimmer. Specifically, pullers always display sliding motion inside the channel: weak pullers slide through the channel centerline, while strong pullers slide through a path close to any of the walls. Pushers generally follow helical motion in a square channel. Unlike pullers and pushers, the trajectories of neutral swimmers are not easy to generalize, and are sensitive to the initial conditions. Despite this diversity in the trajectories, the far-field expressions capture the essential features of channel-confined swimmers. Finally, we propose a method based on the principle of superposition to understand the origin of the three-dimensional trajectories of channel confined swimmers. Such construction allows us to predict and justify the origin of apparently complex 3D trajectories generated by different types of swimmers in channels with square and rectangular cross sections.


title: Collective Sampling: An Ex Ante Perspective

abstract: I study collective dynamic information acquisition. Players determine when to end sequential sampling via a collective stopping rule. With two players, collective stopping is determined either unilaterally or unanimously. I develop a methodology to characterize equilibria using an ex ante perspective on posterior distributions. Under unilateral stopping, each player chooses a mean-preserving contraction of the other's posterior distribution; under unanimous stopping, they choose mean-preserving spreads. Equilibrium sampling regions are determined via concavification. Preference misalignment generates Pareto inefficiency: there is too little learning under unilateral stopping and possibly too much under unanimous stopping. Learning inefficiencies are amplified when players' preferences become less aligned. I demonstrate the value of my methodology in three applications: committee search, dynamic persuasion, and competition in persuasion.


title: Spherical Shalika models on $\mathrm{GU}_{2,2}$ and the theta correspondence for $(\mathrm{GSp}_4,\mathrm{GU}_{2,2})$

abstract: We study Shalika models for generic unramified representations of $\mathrm{GU}_{2,2}$ in the image of the local theta correspondence for the pair $(\mathrm{PGSp}_4,\mathrm{PGU}_{2,2})$. After discussing their uniqueness, we prove a Casselman-Shalika formula which relates the values of spherical Shalika functionals on ${\rm PGU}_{2,2}$ to the values of finite dimensional complex representations of the dual group of $\mathrm{PGSp}_4$.


title: Compressed and Sparse Models for Non-Convex Decentralized Learning

abstract: Recent research highlights frequent model communication as a significant bottleneck to the efficiency of decentralized machine learning (ML), especially for large-scale and over-parameterized neural networks (NNs). To address this, we present Malcom-PSGD, a novel decentralized ML algorithm that combines gradient compression techniques with model sparsification. We promote model sparsity by adding $\ell_1$ regularization to the objective and present a decentralized proximal SGD method for training. Our approach employs vector source coding and dithering-based quantization for the compressed gradient communication of sparsified models. Our analysis demonstrates that Malcom-PSGD achieves a convergence rate of $\mathcal{O}(1/\sqrt{t})$ with respect to the iterations $t$, assuming a constant consensus and learning rate. This result is supported by our proof for the convergence of non-convex compressed Proximal SGD methods. Additionally, we conduct a bit analysis, providing a closed-form expression for the communication costs associated with Malcom-PSGD. Numerical results verify our theoretical findings and demonstrate that our method reduces communication costs by approximately $75\%$ when compared to the state-of-the-art.


title: Brillouin light scattering studies of aqueous E. coli cell lysate: Viscoelastic properties of a multimacromolecular solution

abstract: Brillouin spectroscopy was used to probe the viscoelastic properties of E. coli bacterial cell lysate in aqueous solution at GHz-frequencies over the range -5.0 $^\circ$C $\leq T \leq$ 50.0 $^\circ$C. This work offers a first temperature dependent study on cell lysate by Brillouin light scattering. A single peak was observed in the spectra and attributed to a longitudinal acoustic mode of the solution. The speed of sound, bulk modulus, apparent viscosity and hypersound attenuation were extracted from the frequency shift and FWHM of the spectral peak. This study demonstrate that the behavior of complex multimacromolecular solutions, as shown by \textit{E. coli} lysate, can exhibit viscoelastic properties closely akin to those observed in simple binary aqueous protein solutions. Furthermore, our findings show that by analyzing the raw spectral signature of the Brillouin spectra, it may be possible to identify protein denaturation.


title: On a conjecture of Marton

abstract: We prove a conjecture of K. Marton, widely known as the polynomial Freiman--Ruzsa conjecture, in characteristic $2$. The argument extends to odd characteristic, with details to follow in a subsequent paper.


title: Lagrange and Markov spectra for typical smooth systems

abstract: We prove that among the set of smooth diffeomorphisms there exists a $C^1$-open and dense subset of data such that either the Lagrange spectrum is finite and the dynamics is a Morse-Smale diffeomorphism or the Lagrange spectrum has positive Hausdorff dimension and the system has positive topological entropy.


title: Generative Explanations for Graph Neural Network: Methods and Evaluations

abstract: Graph Neural Networks (GNNs) achieve state-of-the-art performance in various graph-related tasks. However, the black-box nature often limits their interpretability and trustworthiness. Numerous explainability methods have been proposed to uncover the decision-making logic of GNNs, by generating underlying explanatory substructures. In this paper, we conduct a comprehensive review of the existing explanation methods for GNNs from the perspective of graph generation. Specifically, we propose a unified optimization objective for generative explanation methods, comprising two sub-objectives: Attribution and Information constraints. We further demonstrate their specific manifestations in various generative model architectures and different explanation scenarios. With the unified objective of the explanation problem, we reveal the shared characteristics and distinctions among current methods, laying the foundation for future methodological advancements. Empirical results demonstrate the advantages and limitations of different explainability approaches in terms of explanation performance, efficiency, and generalizability.


title: Relativistic electron beams accelerated by an interplanetary shock

abstract: Collisionless shock waves have long been considered amongst the most prolific particle accelerators in the universe. Shocks alter the plasma they propagate through and often exhibit complex evolution across multiple scales. Interplanetary (IP) traveling shocks have been recorded in-situ for over half a century and act as a natural laboratory for experimentally verifying various aspects of large-scale collisionless shocks. A fundamentally interesting problem in both helio and astrophysics is the acceleration of electrons to relativistic energies (more than 300 keV) by traveling shocks. This letter presents first observations of field-aligned beams of relativistic electrons upstream of an IP shock observed thanks to the instrumental capabilities of Solar Orbiter. This study aims to present the characteristics of the electron beams close to the source and contribute towards understanding their acceleration mechanism. On 25 July 2022, Solar Orbiter encountered an IP shock at 0.98 AU. The shock was associated with an energetic storm particle event which also featured upstream field-aligned relativistic electron beams observed 14 minutes prior to the actual shock crossing. The distance of the beam's origin was investigated using a velocity dispersion analysis (VDA). Peak-intensity energy spectra were anaylzed and compared with those obtained from a semi-analytical fast-Fermi acceleration model. By leveraging Solar Orbiter's high-time resolution Energetic Particle Detector (EPD), we have successfully showcased an IP shock's ability to accelerate relativistic electron beams. Our proposed acceleration mechanism offers an explanation for the observed electron beam and its characteristics, while we also explore the potential contributions of more complex mechanisms.


title: Quantization of spherically symmetric loop quantum gravity coupled to a scalar field and a clock: the asymptotic limit

abstract: We continue our work on the study of spherically symmetric loop quantum gravity coupled to two spherically symmetric scalar fields, one which acts as a clock. As a consequence of the presence of the latter, we can define a true Hamiltonian for the theory. The spherically symmetric context allows to carry out precise detailed calculations. Here we study the theory for regions of large values of the radial coordinate. This allows us to define in detail the vacuum of the theory and study its quantum states, yielding a quantum field theory on a quantum space time that makes contact with the usual treatment on classical space times.


title: Dirichlet Energy Enhancement of Graph Neural Networks by Framelet Augmentation

abstract: Graph convolutions have been a pivotal element in learning graph representations. However, recursively aggregating neighboring information with graph convolutions leads to indistinguishable node features in deep layers, which is known as the over-smoothing issue. The performance of graph neural networks decays fast as the number of stacked layers increases, and the Dirichlet energy associated with the graph decreases to zero as well. In this work, we introduce a framelet system into the analysis of Dirichlet energy and take a multi-scale perspective to leverage the Dirichlet energy and alleviate the over-smoothing issue. Specifically, we develop a Framelet Augmentation strategy by adjusting the update rules with positive and negative increments for low-pass and high-passes respectively. Based on that, we design the Energy Enhanced Convolution (EEConv), which is an effective and practical operation that is proved to strictly enhance Dirichlet energy. From a message-passing perspective, EEConv inherits multi-hop aggregation property from the framelet transform and takes into account all hops in the multi-scale representation, which benefits the node classification tasks over heterophilous graphs. Experiments show that deep GNNs with EEConv achieve state-of-the-art performance over various node classification datasets, especially for heterophilous graphs, while also lifting the Dirichlet energy as the network goes deeper.


title: On the Possible Asymmetry in Gamma Rays from Andromeda Due to Inverse Compton Scattering of Star Light on Electrons from Dark Matter Annihilation

abstract: Dark matter is a popular candidate to a new source of primary-charged particles, especially positrons in cosmic rays, which are proposed to account for observable anomalies. While this hypothesis of decaying or annihilating DM is mostly applied for our Galaxy, it could possibly lead to some interesting phenomena when applied for the other ones. In this work, we look into the hypothetical asymmetry in gamma radiation from the upper and lower hemisphere of the dark matter halo of the Andromeda galaxy due to inverse Compton scattering of starlight on the DM-produced electrons and positrons. While our 2D toy model raises expectations for the possible effect, a more complex approach gives negligible effect for the dark halo case, but shows some prospects for a dark disk~model.


title: Chatbots Are Not Reliable Text Annotators

abstract: Recent research highlights the significant potential of ChatGPT for text annotation in social science research. However, ChatGPT is a closed-source product which has major drawbacks with regards to transparency, reproducibility, cost, and data protection. Recent advances in open-source (OS) large language models (LLMs) offer alternatives which remedy these challenges. This means that it is important to evaluate the performance of OS LLMs relative to ChatGPT and standard approaches to supervised machine learning classification. We conduct a systematic comparative evaluation of the performance of a range of OS LLM models alongside ChatGPT, using both zero- and few-shot learning as well as generic and custom prompts, with results compared to more traditional supervised classification models. Using a new dataset of Tweets from US news media, and focusing on simple binary text annotation tasks for standard social science concepts, we find significant variation in the performance of ChatGPT and OS models across the tasks, and that supervised classifiers consistently outperform both. Given the unreliable performance of ChatGPT and the significant challenges it poses to Open Science we advise against using ChatGPT for substantive text annotation tasks in social science research.


title: PolyMaX: General Dense Prediction with Mask Transformer

abstract: Dense prediction tasks, such as semantic segmentation, depth estimation, and surface normal prediction, can be easily formulated as per-pixel classification (discrete outputs) or regression (continuous outputs). This per-pixel prediction paradigm has remained popular due to the prevalence of fully convolutional networks. However, on the recent frontier of segmentation task, the community has been witnessing a shift of paradigm from per-pixel prediction to cluster-prediction with the emergence of transformer architectures, particularly the mask transformers, which directly predicts a label for a mask instead of a pixel. Despite this shift, methods based on the per-pixel prediction paradigm still dominate the benchmarks on the other dense prediction tasks that require continuous outputs, such as depth estimation and surface normal prediction. Motivated by the success of DORN and AdaBins in depth estimation, achieved by discretizing the continuous output space, we propose to generalize the cluster-prediction based method to general dense prediction tasks. This allows us to unify dense prediction tasks with the mask transformer framework. Remarkably, the resulting model PolyMaX demonstrates state-of-the-art performance on three benchmarks of NYUD-v2 dataset. We hope our simple yet effective design can inspire more research on exploiting mask transformers for more dense prediction tasks. Code and model will be made available.


title: Sensitive Schr\"odinger Cat States

abstract: Strong laser-atom interactions can produce highly non-classical states of light by using the process of high-harmonic generation in atoms. When the high-harmonic generation is present, the quantum state of the fundamental mode following the interaction is known as the Schr\"odinger cat state, which is a superposition of the laser's initial coherent state and the coherent state with a smaller amplitude that results from its interaction with atoms. Here, we demonstrate that new light states with significantly different Wigner function distributions can be produced by combining two separate Schr\"odinger cat states. Through the engineering of Schr\"odinger cat states' parameters, we are able to produce Wigner functions that exhibit high sensitivity in relation to the system parameter. Our research paves the way for the creation of non-classical light by superposing Schr\"odinger cat states with application in such as quantum sensing.


title: ADaPT: As-Needed Decomposition and Planning with Language Models

abstract: Large Language Models (LLMs) are increasingly being used for interactive decision-making tasks requiring planning and adapting to the environment. Recent works employ LLMs-as-agents in broadly two ways: iteratively determining the next action (iterative executors) or generating plans and executing sub-tasks using LLMs (plan-and-execute). However, these methods struggle with task complexity, as the inability to execute any sub-task may lead to task failure. To address these shortcomings, we introduce As-Needed Decomposition and Planning for complex Tasks (ADaPT), an approach that explicitly plans and decomposes complex sub-tasks as-needed, i.e., when the LLM is unable to execute them. ADaPT recursively decomposes sub-tasks to adapt to both task complexity and LLM capability. Our results demonstrate that ADaPT substantially outperforms established strong baselines, achieving success rates up to 28.3% higher in ALFWorld, 27% in WebShop, and 33% in TextCraft -- a novel compositional dataset that we introduce. Through extensive analysis, we illustrate the importance of multilevel decomposition and establish that ADaPT dynamically adjusts to the capabilities of the executor LLM as well as to task complexity.


title: An Algorithm for Bichromatic Sorting with Polylog Competitive Ratio

abstract: The problem of sorting with priced information was introduced by [Charikar, Fagin, Guruswami, Kleinberg, Raghavan, Sahai (CFGKRS), STOC 2000]. In this setting, different comparisons have different (potentially infinite) costs. The goal is to find a sorting algorithm with small competitive ratio, defined as the (worst-case) ratio of the algorithm's cost to the cost of the cheapest proof of the sorted order. The simple case of bichromatic sorting posed by [CFGKRS] remains open: We are given two sets $A$ and $B$ of total size $N$, and the cost of an $A-A$ comparison or a $B-B$ comparison is higher than an $A-B$ comparison. The goal is to sort $A \cup B$. An $\Omega(\log N)$ lower bound on competitive ratio follows from unit-cost sorting. Note that this is a generalization of the famous nuts and bolts problem, where $A-A$ and $B-B$ comparisons have infinite cost, and elements of $A$ and $B$ are guaranteed to alternate in the final sorted order. In this paper we give a randomized algorithm InversionSort with an almost-optimal w.h.p. competitive ratio of $O(\log^{3} N)$. This is the first algorithm for bichromatic sorting with a $o(N)$ competitive ratio.


title: Superradiant black hole rocket

abstract: We calculate the total thrust resulting from the interaction between charged scalar modes and a superradiant Reissner-Nordstr\"om black hole, when the modes are deflected by a hemispherical perfect mirror located at a finite distance from the black hole's horizon.


title: On triangulations with fixed areas

abstract: We prove that the number of dissections of a given polygon into triangles with fixed areas of faces is finite and that an equidissection is algebraic as long as the vertices of the original polygon have algebraic coordinates.


title: Multi-fidelity Bayesian Optimisation of Syngas Fermentation Simulators

abstract: A Bayesian optimization approach for maximizing the gas conversion rate in an industrial-scale bioreactor for syngas fermentation is presented. We have access to a high-fidelity, computational fluid dynamic (CFD) reactor model and a low-fidelity ideal-mixing-based reactor model. The goal is to maximize the gas conversion rate, with respect to the input variables (e.g., pressure, biomass concentration, gas flow rate). Due to the high cost of the CFD reactor model, a multi-fidelity Bayesian optimization algorithm is adopted to solve the optimization problem using both high and low fidelities. We first describe the problem in the context of syngas fermentation followed by our approach to solving simulator optimization using multiple fidelities. We discuss concerns regarding significant differences in fidelity cost and their impact on fidelity sampling and conclude with a discussion on the integration of real-world fermentation data.


title: Epitaxial growth and characterization of multi-layer site-controlled InGaAs quantum dots based on the buried stressor method

abstract: We report on the epitaxial growth, theoretical modeling, and structural as well as optical investigation of multi-layer, site-controlled quantum dots fabricated using the buried stressor method. This advanced growth technique utilizes the strain from a partially oxidized AlAs layer to induce site-selective nucleation of InGaAs quantum dots. By implementing strain-induced spectral nano-engineering, we achieve separation in emission energy by about 150 meV of positioned and non-positioned quantum dots and a local increase of the emitter density in a single layer. Furthermore, we achieve a threefold increase of the optical intensity and reduce the inhomogeneous broadening of the ensemble emission by 20% via stacking three layers of site-controlled emitters, which is particularly valuable for using the SCQDs in microlaser applications. Moreover, we obtain direct control over emission properties by adjusting the growth and fabrication parameters. Our optimization of site-controlled growth of quantum dots enables the development of photonic devices with enhanced light-matter interaction and microlasers with increased confinement factor and spontaneous emission coupling efficiency.


title: DONUT-hole: DONUT Sparsification by Harnessing Knowledge and Optimizing Learning Efficiency

abstract: This paper introduces DONUT-hole, a sparse OCR-free visual document understanding (VDU) model that addresses the limitations of its predecessor model, dubbed DONUT. The DONUT model, leveraging a transformer architecture, overcoming the challenges of separate optical character recognition (OCR) and visual semantic understanding (VSU) components. However, its deployment in production environments and edge devices is hindered by high memory and computational demands, particularly in large-scale request services. To overcome these challenges, we propose an optimization strategy based on knowledge distillation and model pruning. Our paradigm to produce DONUT-hole, reduces the model denisty by 54\% while preserving performance. We also achieve a global representational similarity index between DONUT and DONUT-hole based on centered kernel alignment (CKA) metric of 0.79. Moreover, we evaluate the effectiveness of DONUT-hole in the document image key information extraction (KIE) task, highlighting its potential for developing more efficient VDU systems for logistic companies.


title: Language-guided Robot Grasping: CLIP-based Referring Grasp Synthesis in Clutter

abstract: Robots operating in human-centric environments require the integration of visual grounding and grasping capabilities to effectively manipulate objects based on user instructions. This work focuses on the task of referring grasp synthesis, which predicts a grasp pose for an object referred through natural language in cluttered scenes. Existing approaches often employ multi-stage pipelines that first segment the referred object and then propose a suitable grasp, and are evaluated in private datasets or simulators that do not capture the complexity of natural indoor scenes. To address these limitations, we develop a challenging benchmark based on cluttered indoor scenes from OCID dataset, for which we generate referring expressions and connect them with 4-DoF grasp poses. Further, we propose a novel end-to-end model (CROG) that leverages the visual grounding capabilities of CLIP to learn grasp synthesis directly from image-text pairs. Our results show that vanilla integration of CLIP with pretrained models transfers poorly in our challenging benchmark, while CROG achieves significant improvements both in terms of grounding and grasping. Extensive robot experiments in both simulation and hardware demonstrate the effectiveness of our approach in challenging interactive object grasping scenarios that include clutter.


title: Real-time Control of Electric Autonomous Mobility-on-Demand Systems via Graph Reinforcement Learning

abstract: Operators of Electric Autonomous Mobility-on-Demand (E-AMoD) fleets need to make several real-time decisions such as matching available vehicles to ride requests, rebalancing idle vehicles to areas of high demand, and charging vehicles to ensure sufficient range. While this problem can be posed as a linear program that optimizes flows over a space-charge-time graph, the size of the resulting optimization problem does not allow for real-time implementation in realistic settings. In this work, we present the E-AMoD control problem through the lens of reinforcement learning and propose a graph network-based framework to achieve drastically improved scalability and superior performance over heuristics. Specifically, we adopt a bi-level formulation where we (1) leverage a graph network-based RL agent to specify a desired next state in the space-charge graph, and (2) solve more tractable linear programs to best achieve the desired state while ensuring feasibility. Experiments using real-world data from San Francisco and New York City show that our approach achieves up to 89% of the profits of the theoretically-optimal solution while achieving more than a 100x speedup in computational time. We further highlight promising zero-shot transfer capabilities of our learned policy on tasks such as inter-city generalization and service area expansion, thus showing the utility, scalability, and flexibility of our framework. Finally, our approach outperforms the best domain-specific heuristics with comparable runtimes, with an increase in profits by up to 3.2x.


title: Optimal dividend strategies for a catastrophe insurer

abstract: In this paper we study the problem of optimally paying out dividends from an insurance portfolio, when the criterion is to maximize the expected discounted dividends over the lifetime of the company and the portfolio contains claims due to natural catastrophes, modelled by a shot-noise Cox claim number process. The optimal value function of the resulting two-dimensional stochastic control problem is shown to be the smallest viscosity supersolution of a corresponding Hamilton-Jacobi-Bellman equation, and we prove that it can be uniformly approximated through a discretization of the space of the free surplus of the portfolio and the current claim intensity level. We implement the resulting numerical scheme to identify optimal dividend strategies for such a natural catastrophe insurer, and it is shown that the nature of the barrier and band strategies known from the classical models with constant Poisson claim intensity carry over in a certain way to this more general situation, leading to action and non-action regions for the dividend payments as a function of the current surplus and intensity level. We also discuss some interpretations in terms of upward potential for shareholders when including a catastrophe sector in the portfolio.


title: MPGemmFI: A Fault Injection Technique for Mixed Precision GEMM in ML Applications

abstract: Emerging deep learning workloads urgently need fast general matrix multiplication (GEMM). To meet such demand, one of the critical features of machine-learning-specific accelerators such as NVIDIA Tensor Cores, AMD Matrix Cores, and Google TPUs is the support of mixed-precision enabled GEMM. For DNN models, lower-precision FP data formats and computation offer acceptable correctness but significant performance, area, and memory footprint improvement. While promising, the mixed-precision computation on error resilience remains unexplored. To this end, we develop a fault injection framework that systematically injects fault into the mixed-precision computation results. We investigate how the faults affect the accuracy of machine learning applications. Based on the error resilience characteristics, we offer lightweight error detection and correction solutions that significantly improve the overall model accuracy if the models experience hardware faults. The solutions can be efficiently integrated into the accelerator's pipelines.


title: Dimensions associated with surjective local homeomorphisms and subshifts with low complexity

abstract: We prove that the Cuntz-Pimsner algebra associated to any surjective aperiodic one-sided subshift with finitely many left special elements has finite nuclear dimension, which is especially the case for every surjective aperiodic subshift with nonsuperlinear-growth complexity. As a generalization, we define the notions of left speical set, the topological Rokhlin dimension, the tower dimension and the amenability dimension for every local homeomorphism. Then we turn to prove that, for every surjective local homeomorphism with a finite left special set consisting of isolated points, these dimensions along with the dynamic asymptotic dimension are all finite.


title: Are "Hierarchical" Visual Representations Hierarchical?

abstract: Learned visual representations often capture large amounts of semantic information for accurate downstream applications. Human understanding of the world is fundamentally grounded in hierarchy. To mimic this and further improve representation capabilities, the community has explored "hierarchical" visual representations that aim at modeling the underlying hierarchy of the visual world. In this work, we set out to investigate if hierarchical visual representations truly capture the human perceived hierarchy better than standard learned representations. To this end, we create HierNet, a suite of 12 datasets spanning 3 kinds of hierarchy from the BREEDs subset of ImageNet. After extensive evaluation of Hyperbolic and Matryoshka Representations across training setups, we conclude that they do not capture hierarchy any better than the standard representations but can assist in other aspects like search efficiency and interpretability. Our benchmark and the datasets are open-sourced at https://github.com/ethanlshen/HierNet.


title: On Strong Zero-Dispersion Asymptotics for Benjamin-Ono Soliton Ensembles

abstract: A soliton ensemble is a particular kind of approximation of the solution of an initial-value problem for an integrable equation by a reflectionless potential that is well adapted to singular asymptotics like the small-dispersion limit. We show how soliton ensembles for the Benjamin-Ono equation can be analyzed in this limit via the construction of local approximations that capture highly oscillatory features of the solution and hence provide more information than weak convergence results that are easier to obtain. These local approximations are deduced from the distributions of eigenvalues of two related matrices, one Hermitian and another non-Hermitian. We perform careful numerical experiments to deduce the asymptotic behavior of the eigenvalues of these matrices in the small-dispersion limit, and formulate conjectures reflecting our observations. Then we apply the conjectures to construct the local approximations of slowly varying profiles and rapidly oscillating profiles as well. We show that the latter profiles are consistent with the predictions of Whitham modulation theory as originally developed for the Benjamin-Ono equation by Dobrokhotov and Krichever.


title: The structure theorem for sets of length for numerical semigroups

abstract: For sufficiently nice families of semigroups and monoids, the structure theorem for sets of length states that the length set of any sufficiently large element is an arithmetic sequence with some values omitted near the ends. In this paper, we prove a specialized version of the structure theorem that holds for any numerical semigroup $S$. Our description utilizes two other numerical semigroups $S_{\mathsf M}$ and $S_{\mathsf m}$, derived from the generators of $S$: for sufficiently large $n \in S$, the Ap\'ery sets of $S_{\mathsf M}$ and $S_{\mathsf m}$ specify precisely which lengths appear in the length set of $n$, and their gaps specify which lengths are "missing". We also provide an explicit bound on which elements satisfy the structure theorem.


title: Towards stable real-world equation discovery with assessing differentiating quality influence

abstract: This paper explores the critical role of differentiation approaches for data-driven differential equation discovery. Accurate derivatives of the input data are essential for reliable algorithmic operation, particularly in real-world scenarios where measurement quality is inevitably compromised. We propose alternatives to the commonly used finite differences-based method, notorious for its instability in the presence of noise, which can exacerbate random errors in the data. Our analysis covers four distinct methods: Savitzky-Golay filtering, spectral differentiation, smoothing based on artificial neural networks, and the regularization of derivative variation. We evaluate these methods in terms of applicability to problems, similar to the real ones, and their ability to ensure the convergence of equation discovery algorithms, providing valuable insights for robust modeling of real-world processes.


title: Structured Transforms Across Spaces with Cost-Regularized Optimal Transport

abstract: Matching a source to a target probability measure is often solved by instantiating a linear optimal transport (OT) problem, parameterized by a ground cost function that quantifies discrepancy between points. When these measures live in the same metric space, the ground cost often defaults to its distance. When instantiated across two different spaces, however, choosing that cost in the absence of aligned data is a conundrum. As a result, practitioners often resort to solving instead a quadratic Gromow-Wasserstein (GW) problem. We exploit in this work a parallel between GW and cost-regularized OT, the regularized minimization of a linear OT objective parameterized by a ground cost. We use this cost-regularized formulation to match measures across two different Euclidean spaces, where the cost is evaluated between transformed source points and target points. We show that several quadratic OT problems fall in this category, and consider enforcing structure in linear transform (e.g. sparsity), by introducing structure-inducing regularizers. We provide a proximal algorithm to extract such transforms from unaligned data, and demonstrate its applicability to single-cell spatial transcriptomics/multiomics matching tasks.


title: Tensor categories

abstract: We present here definitions and constructions basic for the theory of monoidal and tensor categories. We provide references to the original sources, whenever possible. Group-theoretical categories are used as examples


title: The Paradox of Noise: An Empirical Study of Noise-Infusion Mechanisms to Improve Generalization, Stability, and Privacy in Federated Learning

abstract: In a data-centric era, concerns regarding privacy and ethical data handling grow as machine learning relies more on personal information. This empirical study investigates the privacy, generalization, and stability of deep learning models in the presence of additive noise in federated learning frameworks. Our main objective is to provide strategies to measure the generalization, stability, and privacy-preserving capabilities of these models and further improve them. To this end, five noise infusion mechanisms at varying noise levels within centralized and federated learning settings are explored. As model complexity is a key component of the generalization and stability of deep learning models during training and evaluation, a comparative analysis of three Convolutional Neural Network (CNN) architectures is provided. The paper introduces Signal-to-Noise Ratio (SNR) as a quantitative measure of the trade-off between privacy and training accuracy of noise-infused models, aiming to find the noise level that yields optimal privacy and accuracy. Moreover, the Price of Stability and Price of Anarchy are defined in the context of privacy-preserving deep learning, contributing to the systematic investigation of the noise infusion strategies to enhance privacy without compromising performance. Our research sheds light on the delicate balance between these critical factors, fostering a deeper understanding of the implications of noise-based regularization in machine learning. By leveraging noise as a tool for regularization and privacy enhancement, we aim to contribute to the development of robust, privacy-aware algorithms, ensuring that AI-driven solutions prioritize both utility and privacy.


title: Detecting Suspicious Commenter Mob Behaviors on YouTube Using Graph2Vec

abstract: YouTube, a widely popular online platform, has transformed the dynamics of con-tent consumption and interaction for users worldwide. With its extensive range of content crea-tors and viewers, YouTube serves as a hub for video sharing, entertainment, and information dissemination. However, the exponential growth of users and their active engagement on the platform has raised concerns regarding suspicious commenter behaviors, particularly in the com-ment section. This paper presents a social network analysis-based methodology for detecting suspicious commenter mob-like behaviors among YouTube channels and the similarities therein. The method aims to characterize channels based on the level of such behavior and identify com-mon patterns across them. To evaluate the effectiveness of the proposed model, we conducted an analysis of 20 YouTube channels, consisting of 7,782 videos, 294,199 commenters, and 596,982 comments. These channels were specifically selected for propagating false views about the U.S. Military. The analysis revealed significant similarities among the channels, shedding light on the prevalence of suspicious commenter behavior. By understanding these similarities, we contribute to a better understanding of the dynamics of suspicious behavior on YouTube channels, which can inform strategies for addressing and mitigating such behavior.


title: Is a Seat at the Table Enough? Engaging Teachers and Students in Dataset Specification for ML in Education

abstract: Despite the promises of ML in education, its adoption in the classroom has surfaced numerous issues regarding fairness, accountability, and transparency, as well as concerns about data privacy and student consent. A root cause of these issues is the lack of understanding of the complex dynamics of education, including teacher-student interactions, collaborative learning, and classroom environment. To overcome these challenges and fully utilize the potential of ML in education, software practitioners need to work closely with educators and students to fully understand the context of the data (the backbone of ML applications) and collaboratively define the ML data specifications. To gain a deeper understanding of such a collaborative process, we conduct ten co-design sessions with ML software practitioners, educators, and students. In the sessions, teachers and students work with ML engineers, UX designers, and legal practitioners to define dataset characteristics for a given ML application. We find that stakeholders contextualize data based on their domain and procedural knowledge, proactively design data requirements to mitigate downstream harms and data reliability concerns, and exhibit role-based collaborative strategies and contribution patterns. Further, we find that beyond a seat at the table, meaningful stakeholder participation in ML requires structured supports: defined processes for continuous iteration and co-evaluation, shared contextual data quality standards, and information scaffolds for both technical and non-technical stakeholders to traverse expertise boundaries.


title: Crosstalk effects in microwave SQUID multiplexed TES bolometer readout

abstract: Transition-edge sensor (TES) bolometers are broadly used for background-limited astrophysical measurements from the far-infrared to mm-waves. Many planned future instruments require increasingly large detector arrays, but their scalability is limited by their cryogenic readout electronics. Microwave SQUID multiplexing offers a highly capable scaling solution through the use of inherently broadband circuitry, enabling readout of hundreds to thousands of channels per microwave line. As with any multiplexing technique, the channelization mechanism gives rise to electrical crosstalk which must be understood and controlled so as to not degrade the instrument sensitivity. Here, we explore implications relevant for TES bolometer array applications, focusing in particular on upcoming mm-wave observatories such as the Simons Observatory and AliCPT. We model the relative contributions of the various underlying crosstalk mechanisms, evaluate the difference between fixed-tone and tone-tracking readout systems, and discuss ways in which crosstalk nonlinearity will complicate on-sky measurements.


title: An Experimental Design for Anytime-Valid Causal Inference on Multi-Armed Bandits

abstract: Experimentation is crucial for managers to rigorously quantify the value of a change and determine if it leads to a statistically significant improvement over the status quo, thus augmenting their decision-making. Many companies now mandate that all changes undergo experimentation, presenting two challenges: (1) reducing the risk/cost of experimentation by minimizing the proportion of customers assigned to the inferior treatment and (2) increasing the experimentation velocity by enabling managers to stop experiments as soon as results are statistically significant. This paper simultaneously addresses both challenges by proposing the Mixture Adaptive Design (MAD), a new experimental design for multi-armed bandit (MAB) algorithms that enables anytime valid inference on the Average Treatment Effect (ATE) for any MAB algorithm. Intuitively, the MAB "mixes" any bandit algorithm with a Bernoulli design such that at each time step, the probability that a customer is assigned via the Bernoulli design is controlled by a user-specified deterministic sequence that can converge to zero. The sequence enables managers to directly and interpretably control the trade-off between regret minimization and inferential precision. Under mild conditions on the rate the sequence converges to zero, we provide a confidence sequence that is asymptotically anytime valid and demonstrate that the MAD is guaranteed to have a finite stopping time in the presence of a true non-zero ATE. Hence, the MAD allows managers to stop experiments early when a significant ATE is detected while ensuring valid inference, enhancing both the efficiency and reliability of adaptive experiments. Empirically, we demonstrate that the MAD achieves finite-sample anytime-validity while accurately and precisely estimating the ATE, all without incurring significant losses in reward compared to standard bandit designs.


title: Improvements on Uncertainty Quantification for Node Classification via Distance-Based Regularization

abstract: Deep neural networks have achieved significant success in the last decades, but they are not well-calibrated and often produce unreliable predictions. A large number of literature relies on uncertainty quantification to evaluate the reliability of a learning model, which is particularly important for applications of out-of-distribution (OOD) detection and misclassification detection. We are interested in uncertainty quantification for interdependent node-level classification. We start our analysis based on graph posterior networks (GPNs) that optimize the uncertainty cross-entropy (UCE)-based loss function. We describe the theoretical limitations of the widely-used UCE loss. To alleviate the identified drawbacks, we propose a distance-based regularization that encourages clustered OOD nodes to remain clustered in the latent space. We conduct extensive comparison experiments on eight standard datasets and demonstrate that the proposed regularization outperforms the state-of-the-art in both OOD detection and misclassification detection.


title: Magnetic Field Strength Effects on Nucleosynthesis from Neutron Star Merger Outflows

abstract: Magnetohydrodynamic turbulence drives the central engine of post-merger remnants, potentially powering both a nucleosynthetically active disk wind and the relativistic jet behind a short gamma ray burst. We explore the impact of the magnetic field on this engine by simulating three post-merger black hole accretion disks using general relativistic magnetohydrodynamics with Monte Carlo neutrino transport, in each case varying the initial magnetic field strength. We find increasing ejecta masses associated with increasing magnetic field strength. We find that a fairly robust main r -process pattern is produced in all three cases, scaled by the ejected mass. Changing the initial magnetic field strength has a considerable effect on the geometry of the outflow and hints at complex central engine dynamics influencing lanthanide outflows. We find that actinide production is especially sensitive to magnetic field strength, with overall actinide mass fraction calculated at 1 Gyr post-merger increasing by more than a factor of six with a tenfold increase in magnetic field strength. This hints at a possible connection to the variability in actinide enhancements exhibited by metal poor, r -process-enhanced stars.


title: Stochastic quantization of the three-dimensional polymer measure via the Dirichlet form method

abstract: We prove that there exists a diffusion process whose invariant measure is the three dimensional polymer measure $\nu_\lambda$ for small $\lambda>0$. We follow in part a previous incomplete unpublished work of the first named author with M. R\"ockner and X.Y. Zhou. For the construction of $\nu_\lambda$ we rely on previous work by J. Westwater, E. Bolthausen and X.Y. Zhou. Using $\nu_\lambda$, the diffusion is constructed by means of the theory of Dirichlet forms on infinite-dimensional state spaces. The closability of the appropriate pre-Dirichlet form which is of gradient type is proven, by using a general closability result in [AR89a]. This result does not require an integration by parts formula (which does not even hold for the two-dimensional polymer measure $\nu_\lambda$) but requires the quasi-invariance of $\nu_\lambda$ along a basis of vectors in the classical Cameron-Martin space such that the Radon-Nikodym derivatives have versions which form a continuous process.


title: Synthesizing Bidirectional Temporal States of Knee Osteoarthritis Radiographs with Cycle-Consistent Generative Adversarial Neural Networks

abstract: Knee Osteoarthritis (KOA), a leading cause of disability worldwide, is challenging to detect early due to subtle radiographic indicators. Diverse, extensive datasets are needed but are challenging to compile because of privacy, data collection limitations, and the progressive nature of KOA. However, a model capable of projecting genuine radiographs into different OA stages could augment data pools, enhance algorithm training, and offer pre-emptive prognostic insights. In this study, we trained a CycleGAN model to synthesize past and future stages of KOA on any genuine radiograph. The model was validated using a Convolutional Neural Network that was deceived into misclassifying disease stages in transformed images, demonstrating the CycleGAN's ability to effectively transform disease characteristics forward or backward in time. The model was particularly effective in synthesizing future disease states and showed an exceptional ability to retroactively transition late-stage radiographs to earlier stages by eliminating osteophytes and expanding knee joint space, signature characteristics of None or Doubtful KOA. The model's results signify a promising potential for enhancing diagnostic models, data augmentation, and educational and prognostic usage in healthcare. Nevertheless, further refinement, validation, and a broader evaluation process encompassing both CNN-based assessments and expert medical feedback are emphasized for future research and development.


title: Adaptive Variance Thresholding: A Novel Approach to Improve Existing Deep Transfer Vision Models and Advance Automatic Knee-Joint Osteoarthritis Classification

abstract: Knee-Joint Osteoarthritis (KOA) is a prevalent cause of global disability and is inherently complex to diagnose due to its subtle radiographic markers and individualized progression. One promising classification avenue involves applying deep learning methods; however, these techniques demand extensive, diversified datasets, which pose substantial challenges due to medical data collection restrictions. Existing practices typically resort to smaller datasets and transfer learning. However, this approach often inherits unnecessary pre-learned features that can clutter the classifier's vector space, potentially hampering performance. This study proposes a novel paradigm for improving post-training specialized classifiers by introducing adaptive variance thresholding (AVT) followed by Neural Architecture Search (NAS). This approach led to two key outcomes: an increase in the initial accuracy of the pre-trained KOA models and a 60-fold reduction in the NAS input vector space, thus facilitating faster inference speed and a more efficient hyperparameter search. We also applied this approach to an external model trained for KOA classification. Despite its initial performance, the application of our methodology improved its average accuracy, making it one of the top three KOA classification models.


title: Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrieval

abstract: There has been limited success for dense retrieval models in multilingual retrieval, due to uneven and scarce training data available across multiple languages. Synthetic training data generation is promising (e.g., InPars or Promptagator), but has been investigated only for English. Therefore, to study model capabilities across both cross-lingual and monolingual retrieval tasks, we develop SWIM-IR, a synthetic retrieval training dataset containing 33 (high to very-low resource) languages for fine-tuning multilingual dense retrievers without requiring any human supervision. To construct SWIM-IR, we propose SAP (summarize-then-ask prompting), where the large language model (LLM) generates a textual summary prior to the query generation step. SAP assists the LLM in generating informative queries in the target language. Using SWIM-IR, we explore synthetic fine-tuning of multilingual dense retrieval models and evaluate them robustly on three retrieval benchmarks: XOR-Retrieve (cross-lingual), MIRACL (monolingual) and XTREME-UP (cross-lingual). Our models, called SWIM-X, are competitive with human-supervised dense retrieval models, e.g., mContriever-X, finding that SWIM-IR can cheaply substitute for expensive human-labeled retrieval training data. SWIM-IR dataset and SWIM-X models are available at https://github.com/google-research-datasets/SWIM-IR.


title: Using Azure Quantum Resource Estimator for Assessing Performance of Fault Tolerant Quantum Computation

abstract: The resource estimation tools provided by Azure Quantum and Azure Quantum Development Kit are described. Using these tools one can automatically evaluate the logical and physical resources required to run algorithms on fault-tolerant quantum computers. An example is given of obtaining resource estimates for quantum fault-tolerant implementations of three different multiplication algorithms.


title: Generative Modeling of Residuals for Real-Time Risk-Sensitive Safety with Discrete-Time Control Barrier Functions

abstract: A key source of brittleness for robotic systems is the presence of model uncertainty and external disturbances. Most existing approaches to robust control either seek to bound the worst-case disturbance (which results in conservative behavior), or to learn a deterministic dynamics model (which is unable to capture uncertain dynamics or disturbances). This work proposes a different approach: training a state-conditioned generative model to represent the distribution of error residuals between the nominal dynamics and the actual system. In particular we introduce the Online Risk-Informed Optimization controller (ORIO), which uses Discrete-Time Control Barrier Functions, combined with a learned, generative disturbance model, to ensure the safety of the system up to some level of risk. We demonstrate our approach in both simulations and hardware, and show our method can learn a disturbance model that is accurate enough to enable risk-sensitive control of a quadrotor flying aggressively with an unmodelled slung load. We use a conditional variational autoencoder (CVAE) to learn a state-conditioned dynamics residual distribution, and find that the resulting probabilistic safety controller, which can be run at 100Hz on an embedded computer, exhibits less conservative behavior while retaining theoretical safety properties.


title: Entropy Production on Cooperative Opinion Dynamics

abstract: As one of the most widespread social dynamics, cooperative behavior is among the most fascinating collective phenomena. Several animal species, from social insects to human beings, feature social groups altruistically working for a common benefit. This collaborative conduct pervades the actions and opinions of individuals, yielding strategic decision-making between political, religious, ethnic, and economic social puzzles. Here, we explore how cooperative behavior phenomena impact collective opinion dynamics and entropy generation in social groups. We select a random fraction $f$ of community members as collaborative individuals and model the opinion dynamics using a social temperature parameter $q$ that functions as a social anxiety noise. With probability $q$, regular individuals oppose their companions about a social decision, assuming group dissent. Collaborative agents experience a reduced effective social noise $\mu q$, where $0 < \mu < 1$ is the social anxiety noise sensibility parameter that enhances social validation. We perform numerical simulations and mean-field analysis and find the system undergoes nonequilibrium order-disorder phase transitions with expressive social entropy production. Our results also highlight the effects of an individual social anxiety attenuation level in enhancing group consensus and inducing exuberant collective phenomena in complex systems.


title: Model-as-a-Service (MaaS): A Survey

abstract: Due to the increased number of parameters and data in the pre-trained model exceeding a certain level, a foundation model (e.g., a large language model) can significantly improve downstream task performance and emerge with some novel special abilities (e.g., deep learning, complex reasoning, and human alignment) that were not present before. Foundation models are a form of generative artificial intelligence (GenAI), and Model-as-a-Service (MaaS) has emerged as a groundbreaking paradigm that revolutionizes the deployment and utilization of GenAI models. MaaS represents a paradigm shift in how we use AI technologies and provides a scalable and accessible solution for developers and users to leverage pre-trained AI models without the need for extensive infrastructure or expertise in model training. In this paper, the introduction aims to provide a comprehensive overview of MaaS, its significance, and its implications for various industries. We provide a brief review of the development history of "X-as-a-Service" based on cloud computing and present the key technologies involved in MaaS. The development of GenAI models will become more democratized and flourish. We also review recent application studies of MaaS. Finally, we highlight several challenges and future issues in this promising area. MaaS is a new deployment and service paradigm for different AI-based models. We hope this review will inspire future research in the field of MaaS.


title: Generic forms

abstract: We determine the Hilbert series of some classes of ideals generated by generic forms of degree two and three, and investigate the difference to the Hilbert series of ideals generated by powers of linear generic forms of the corresponding degrees.


title: Likelihood ratio tests in random graph models with increasing dimensions

abstract: We explore the Wilks phenomena in two random graph models: the $\beta$-model and the Bradley-Terry model. For two increasing dimensional null hypotheses, including a specified null $H_0: \beta_i=\beta_i^0$ for $i=1,\ldots, r$ and a homogenous null $H_0: \beta_1=\cdots=\beta_r$, we reveal high dimensional Wilks' phenomena that the normalized log-likelihood ratio statistic, $[2\{\ell(\widehat{\mathbf{\beta}}) - \ell(\widehat{\mathbf{\beta}}^0)\} -r]/(2r)^{1/2}$, converges in distribution to the standard normal distribution as $r$ goes to infinity. Here, $\ell( \mathbf{\beta})$ is the log-likelihood function on the model parameter $\mathbf{\beta}=(\beta_1, \ldots, \beta_n)^\top$, $\widehat{\mathbf{\beta}}$ is its maximum likelihood estimator (MLE) under the full parameter space, and $\widehat{\mathbf{\beta}}^0$ is the restricted MLE under the null parameter space. For the homogenous null with a fixed $r$, we establish Wilks-type theorems that $2\{\ell(\widehat{\mathbf{\beta}}) - \ell(\widehat{\mathbf{\beta}}^0)\}$ converges in distribution to a chi-square distribution with $r-1$ degrees of freedom, as the total number of parameters, $n$, goes to infinity. When testing the fixed dimensional specified null, we find that its asymptotic null distribution is a chi-square distribution in the $\beta$-model. However, unexpectedly, this is not true in the Bradley-Terry model. By developing several novel technical methods for asymptotic expansion, we explore Wilks type results in a principled manner; these principled methods should be applicable to a class of random graph models beyond the $\beta$-model and the Bradley-Terry model. Simulation studies and real network data applications further demonstrate the theoretical results.


title: Quantum light microscopy

abstract: Much of our progress in understanding microscale biology has been powered by advances in microscopy. For instance, super-resolution microscopes allow the observation of biological structures at near-atomic-scale resolution, while multi-photon microscopes allow imaging deep into tissue. However, biological structures and dynamics still often remain out of reach of existing microscopes, with further advances in signal-to-noise, resolution and speed needed to access them. In many cases, the performance of microscopes is now limited by quantum effects -- such as noise due to the quantisation of light into photons or, for multi-photon microscopes, the low cross-section of multi-photon scattering. These limitations can be overcome by exploiting features of quantum mechanics such as entanglement. Quantum effects can also provide new ways to enhance the performance of microscopes, such as new super-resolution techniques and new techniques to image at difficult to reach wavelengths. This review provides an overview of these various ways in which quantum techniques can improve microscopy, including recent experimental progress. It seeks to provide a realistic picture of what is possible, and what the constraints and opportunities are.


title: Scale-MIA: A Scalable Model Inversion Attack against Secure Federated Learning via Latent Space Reconstruction

abstract: Federated learning is known for its capability to safeguard participants' data privacy. However, recently emerged model inversion attacks (MIAs) have shown that a malicious parameter server can reconstruct individual users' local data samples through model updates. The state-of-the-art attacks either rely on computation-intensive search-based optimization processes to recover each input batch, making scaling difficult, or they involve the malicious parameter server adding extra modules before the global model architecture, rendering the attacks too conspicuous and easily detectable. To overcome these limitations, we propose Scale-MIA, a novel MIA capable of efficiently and accurately recovering training samples of clients from the aggregated updates, even when the system is under the protection of a robust secure aggregation protocol. Unlike existing approaches treating models as black boxes, Scale-MIA recognizes the importance of the intricate architecture and inner workings of machine learning models. It identifies the latent space as the critical layer for breaching privacy and decomposes the complex recovery task into an innovative two-step process to reduce computation complexity. The first step involves reconstructing the latent space representations (LSRs) from the aggregated model updates using a closed-form inversion mechanism, leveraging specially crafted adversarial linear layers. In the second step, the whole input batches are recovered from the LSRs by feeding them into a fine-tuned generative decoder. We implemented Scale-MIA on multiple commonly used machine learning models and conducted comprehensive experiments across various settings. The results demonstrate that Scale-MIA achieves excellent recovery performance on different datasets, exhibiting high reconstruction rates, accuracy, and attack efficiency on a larger scale compared to state-of-the-art MIAs.


title: Distribution of H-alpha Emitters in Merging Galaxy Clusters

abstract: Studies of star formation in various galaxy cluster mergers have reached apparently contradictory conclusions regarding whether mergers stimulate star formation, quench it, or have no effect. Because the mergers studied span a range of time since pericenter (TSP), it is possible that the apparent effect on star formation is a function of TSP. We use a sample of 12 bimodal mergers to assess the star formation as a function of TSP. We measure the equivalent width of the H-alpha emission line in ${\sim}100$ member galaxies in each merger, classify galaxies as emitters or non-emitters, and then classify emitters as star-forming galaxies (SFG) or active galactic nucleus (AGN) based on the [NII] $\lambda6583$ line. We quantify the distribution of SFG and AGN relative to non-emitters along the spatial axis defined by the subcluster separation. The SFG and AGN fractions vary from merger to merger, but show no trend with TSP. The spatial distribution of SFG is consistent with that of non-emitters in eight mergers, but show significant avoidance of the system center in the remaining four mergers, including the three with the lowest TSP. If there is a connection between star formation activity and TSP, probing it further will require more precise TSP estimates and more mergers with TSP in the range of 0-400 Myr.


title: Interactive Motion Planning for Autonomous Vehicles via Adaptive Interactive MPC

abstract: This article presents a new optimal control-based interactive motion planning algorithm for an autonomous vehicle interacting with a human-driven vehicle. The ego vehicle solves a joint optimization problem for its motion planning involving costs and coupled constraints of both vehicles and applies its own actions. The non-convex feasible region and lane discipline are handled by introducing integer decision variables and the resulting optimization problem is a mixed-integer quadratic program (MIQP) which is implemented via model predictive control (MPC). Furthermore, the ego vehicle imputes the cost of human-driven neighboring vehicle (NV) using an inverse optimal control method based on Karush-Kuhn-Tucker (KKT) conditions and adapts the joint optimization cost accordingly. We call the algorithm adaptive interactive mixed-integer MPC (aiMPC). Its interaction with human subjects driving the NV in a mandatory lane change scenario is tested in a developed software-and-human-in-the-loop simulator. Results show the effectiveness of the presented algorithm in terms of enhanced mobility of both the vehicles compared to baseline methods.


title: YOLOv5s-BC: An improved YOLOv5s-based method for real-time apple detection

abstract: To address the issues associated with the existing algorithms for the current apple detection, this study proposes an improved YOLOv5s-based method, named YOLOv5s-BC, for real-time apple detection, in which a series of modifications have been introduced. Firstly, a coordinate attention (CA) block has been incorporated into the backbone module to construct a new backbone network. Secondly, the original concatenation operation has been replaced with a bidirectional feature pyramid network (BiFPN) in the neck module. Lastly, a new detection head has been added to the head module, enabling the detection of smaller and more distant targets within the field of view of the robot. The proposed YOLOv5s-BC model was compared to several target detection algorithms, including YOLOv5s, YOLOv4, YOLOv3, SSD, Faster R-CNN (ResNet50), and Faster R-CNN (VGG), with significant improvements of 4.6%, 3.6%, 20.48%, 23.22%, 15.27%, and 15.59% in mAP, respectively. The detection accuracy of the proposed model is also greatly enhanced over the original YOLOv5s model. The model boasts an average detection speed of 0.018 seconds per image, and the weight size is only 16.7 Mb with 4.7 Mb smaller than that of YOLOv8s, meeting the real-time requirements for the picking robot. Furthermore, according to the heat map, our proposed model can focus more on and learn the high-level features of the target apples, and recognize the smaller target apples better than the original YOLOv5s model. Then, in other apple orchard tests, the model can detect the pickable apples in real time and correctly, illustrating a decent generalization ability.


title: CFBenchmark: Chinese Financial Assistant Benchmark for Large Language Model

abstract: Large language models (LLMs) have demonstrated great potential in the financial domain. Thus, it becomes important to assess the performance of LLMs in the financial tasks. In this work, we introduce CFBenchmark, to evaluate the performance of LLMs for Chinese financial assistant. The basic version of CFBenchmark is designed to evaluate the basic ability in Chinese financial text processing from three aspects~(\emph{i.e.} recognition, classification, and generation) including eight tasks, and includes financial texts ranging in length from 50 to over 1,800 characters. We conduct experiments on several LLMs available in the literature with CFBenchmark-Basic, and the experimental results indicate that while some LLMs show outstanding performance in specific tasks, overall, there is still significant room for improvement in basic tasks of financial text processing with existing models. In the future, we plan to explore the advanced version of CFBenchmark, aiming to further explore the extensive capabilities of language models in more profound dimensions as a financial assistant in Chinese. Our codes are released at https://github.com/TongjiFinLab/CFBenchmark.


title: Feasibility Analysis and Regularity Characterization of Distributionally Robust Safe Stabilizing Controllers

abstract: This paper studies the well-posedness and regularity of safe stabilizing optimization-based controllers for control-affine systems in the presence of model uncertainty. When the system dynamics contain unknown parameters, a finite set of samples can be used to formulate distributionally robust versions of control barrier function and control Lyapunov function constraints. Control synthesis with such distributionally robust constraints can be achieved by solving a (convex) second-order cone program (SOCP). We provide one necessary and two sufficient conditions to check the feasibility of such optimization problems, characterize their computational complexity and numerically show that they are significantly faster to check than direct use of SOCP solvers. Finally, we also analyze the regularity of the resulting control laws.


title: Majorana corner modes and tunable patterns in an altermagnet heterostructure

abstract: The mutual competition and synergy of magnetism and superconductivity provide us with a very valuable opportunity to access topological superconductivity and Majorana Fermions. Here, we devise a heterostructure consisting of an $s$-wave superconductor, a 2D topological insulator and an altermagnet, which is classified as the third magnet and featured by zero magnetization but spin polarization in both real and reciprocal spaces. We find that the altermagnet can induce mass terms at the edges that compete with electron pairing, and mass domains are formed at the corners of sample, resulting in zero-energy Majorana corner modes (MCMs). The presence or absence of MCMs can be engineered by only changing the direction of the N\'{e}el vector. Moreover, uniaxial strain can effectively manipulate the patterns of the MCMs, such as moving and interchanging MCMs. Experimental realization, remarkable advantages of our proposal and possible braiding are discussed.


title: Imprints of Sagittarius accretion event: Young O-rich stars and discontinuous chemical evolution in Milky Way disc

abstract: The Milky Way has undergone significant transformations in its early history, characterised by violent mergers and the accretion of satellite galaxies. Among these events, the infall of the satellite galaxy Gaia-Enceladus/Sausage is recognised as the last major merger event, fundamentally altering the evolution of the Milky Way and shaping its chemo-dynamical structure. However, recent observational evidence suggests that the Milky Way remains undergone notable events of star formation in the past 4 Gyr, which is thought to be triggered by the perturbations from Sagittarius dwarf galaxy (Sgr). Here we report chemical signatures of the Sgr accretion event in the past 4 Gyr, using the [Fe/H] and [O/Fe] ratios in the thin disc, which is reported for the first time. It reveals that the previously discovered V-shape structure of age-[Fe/H] relation varies across different Galactic locations and has rich substructures. Interestingly, we discover a discontinuous structure at z$_{\rm max}$ $<$ 0.3 kpc, interrupted by a recent burst of star formation from 4 Gyr to 2 Gyr ago. In this episode, we find a significant rise in oxygen abundance leading to a distinct [O/Fe] gradient, contributing to the formation of young O-rich stars. Combined with the simulated star formation history and chemical abundance of Sgr, we suggest that the Sgr is an important actor in the discontinuous chemical evolution of the Milky Way disc.


title: Full-length-body CBCT imaging in upright position with robotic-arm system: a simulation study

abstract: Upright position CT scans make it possible for full-length-body imaging at conditions more relevant to daily situations, but the substantial weight of the upright CT scanners increases the risks to floor's stability and patients'safety. Robotic-arm CBCT systems are supposed to be a better solution for this task, but such systems still face challenges including long scanning time and low reconstruction quality. To address the above challenges, this paper proposes a novel method to calculate optimal scanning pitch based on data completeness analysis, which can complete the whole-body scan in the shortest time without a significant decline in image quality. Besides, an FDK-style reconstruction method based on normalized projections is proposed to obtain fast image reconstruction. Extensive experiments prove the effectiveness of the proposed optimal scanning trajectory. Qualitative and quantitative comparisons with FDK and iterative algorithms show that the proposed reconstruction method can obtain high imaging quality with reasonable computation costs. The method proposed in this paper is expected to promote the application of robotic-arm CBCT systems in orthopedic functional analysis.


title: Volume product

abstract: In this expository paper we discuss the volume product P(K) of convex bodies K in $R^n$; this is the product of volumes of K and its polar K*. The Blaschke- Santalo inequalities state that always $ P(K) \le P(B_2)$ and $ P(B_1)\le P(K)$ . Here the Closed unit Ball in norm of $l_2$ is denoted by $B_2$ and like wise for the $l_1$ unit ball. The upper bound is classical, due to Santalo in general and Blaschke and Mahler much earlier in 1930 s for dimensions 2 and 3. The lower bound is open for general K. However the result of Gordon, Meyer and Riesner says that the class of zonoids K attain the lower bound. There is Bianchi and Kelly' s proof of the upper bound in general,involving Paley-Wiener Theorem , as generalized to $R^n$ by Stein . For the lower bound, there is the result of of Kim and Zvavitch on its stability under perturbations of unconditional K . Further there are results on " functional" versions of Blashke -Santalo Inequality . In this context we discuss the newer concept of "Polar f* " for certain type of functions f and its relevance here and mention as a "functional" example a result by S.Artstein, B.Klartag and V.Milman . We mention a later one by Huang and Ai- Jun Li and discuss Ball's Inequality for unconditional bodies,another strengthening of the Blaschke-Santalo inequality .


title: Learning Agile Bipedal Motions on a Quadrupedal Robot

abstract: Can a quadrupedal robot perform bipedal motions like humans? Although developing human-like behaviors is more often studied on costly bipedal robot platforms, we present a solution over a lightweight quadrupedal robot that unlocks the agility of the quadruped in an upright standing pose and is capable of a variety of human-like motions. Our framework is with a hierarchical structure. At the low level is a motion-conditioned control policy that allows the quadrupedal robot to track desired base and front limb movements while balancing on two hind feet. The policy is commanded by a high-level motion generator that gives trajectories of parameterized human-like motions to the robot from multiple modalities of human input. We for the first time demonstrate various bipedal motions on a quadrupedal robot, and showcase interesting human-robot interaction modes including mimicking human videos, following natural language instructions, and physical interaction. The video is available at https://sites.google.com/view/bipedal-motions-quadruped.


title: A flexible framework for synthesizing human activity patterns with application to sequential categorical data

abstract: The ability to synthesize realistic data in a parametrizable way is valuable for a number of reasons, including privacy, missing data imputation, and evaluating the performance of statistical and computational methods. When the underlying data generating process is complex, data synthesis requires approaches that balance realism and simplicity. In this paper, we address the problem of synthesizing sequential categorical data of the type that is increasingly available from mobile applications and sensors that record participant status continuously over the course of multiple days and weeks. We propose the paired Markov Chain (paired-MC) method, a flexible framework that produces sequences that closely mimic real data while providing a straightforward mechanism for modifying characteristics of the synthesized sequences. We demonstrate the paired-MC method on two datasets, one reflecting daily human activity patterns collected via a smartphone application, and one encoding the intensities of physical activity measured by wearable accelerometers. In both settings, sequences synthesized by paired-MC better capture key characteristics of the real data than alternative approaches.