title: The Gig's Up: How ChatGPT Stacks Up Against Quora on Gig Economy Insights

abstract: Generative AI is changing the way in which humans seek to find answers to questions in different fields including on the gig economy and labour markets, but there is limited information available about closely ChatGPT simulated output matches that obtainable from existing question and answer platforms. This paper uses ChatGPT as a research assistant to explore how far ChatGPT can replicate Quora question and answers, using data from the gig economy as an indicative case study. The results from content analysis suggest that Quora is likely to be asked questions from users looking to make money and answers are likely to include personal experiences and examples. ChatGPT simulated versions are less personal and more concept-based, including considerations on employment implications and labour rights. It appears therefore that generative AI simulates only part of what a human would want in their answers relating to the gig economy. The paper proposes that a similar comparative methodology would also be useful across other research fields to help in establishing the best real world uses of generative AI.


title: Tunable-fidelity wave functions for the \textit{ab initio} description of scattering and reactions

abstract: The no-core shell model (NCSM) is an \textit{ab initio} method that solves the nuclear many-body problem by expanding the many-particle wave function into a (typically) harmonic oscillator basis and minimizing the energy to obtain the expansion coefficients. Extensions of the NCSM, such as its coupling with microscopic-cluster basis states, further allow for an \textit{ab initio} treatment of light-ion nuclear reactions of interest for both astrophysics and nuclear technology applications. A downside of the method is the exponential scaling of the basis size with increasing number of nucleons and excitation quanta, which limits its applicability to mass $A\lesssim 16$ nuclei, except for variants where the basis is further down-selected via some truncation scheme. We consider a basis selection method for the NCSM that captures the essential degrees of freedom of the nuclear wave function leading to a favorable complexity scaling for calculations and enabling \textit{ab initio} reaction calculations in $sd$-shell nuclei. The particle configurations within the NCSM basis are ordered based on their contribution to the first moment of the Hamiltonian matrix that results from the projection onto the many-body basis. The truncation scheme then consists in retaining only the lowest-first-moment configurations, which typically contain only few many-body basis states (Slater determinants). We present calculations for $^7$Li and $n+^{12}$C scattering using nucleon-nucleon interactions derived from chiral effective field theory and softened using the similarity renormalization group method. The obtained energy levels invariably demonstrate exponential convergence with the size of the basis, and we find improved convergence in scattering calculations. To demonstrate the possibilities enabled by the approach, we also present a first calculation for the scattering of neutrons from $^{24}$Mg.


title: Counterfactual Explanations of Black-box Machine Learning Models using Causal Discovery with Applications to Credit Rating

abstract: Explainable artificial intelligence (XAI) has helped elucidate the internal mechanisms of machine learning algorithms, bolstering their reliability by demonstrating the basis of their predictions. Several XAI models consider causal relationships to explain models by examining the input-output relationships of prediction models and the dependencies between features. The majority of these models have been based their explanations on counterfactual probabilities, assuming that the causal graph is known. However, this assumption complicates the application of such models to real data, given that the causal relationships between features are unknown in most cases. Thus, this study proposed a novel XAI framework that relaxed the constraint that the causal graph is known. This framework leveraged counterfactual probabilities and additional prior information on causal structure, facilitating the integration of a causal graph estimated through causal discovery methods and a black-box classification model. Furthermore, explanatory scores were estimated based on counterfactual probabilities. Numerical experiments conducted employing artificial data confirmed the possibility of estimating the explanatory score more accurately than in the absence of a causal graph. Finally, as an application to real data, we constructed a classification model of credit ratings assigned by Shiga Bank, Shiga prefecture, Japan. We demonstrated the effectiveness of the proposed method in cases where the causal graph is unknown.


title: Near-IR clumps and their properties in high-z galaxies with JWST/NIRCam

abstract: Resolved stellar morphology of z>1 galaxies was inaccessible before JWST. This limitation, due to the impact of dust on rest-frame UV light, had withheld major observational conclusions required to understand the importance of clumps in galaxy evolution. Essentially independent of this issue, we use the rest-frame near-IR for a stellar-mass dependent clump detection method and determine reliable estimations of selection effects. We exploit publicly available JWST/NIRCam and HST/ACS imaging data from CEERS, to create a stellar-mass based picture of clumps in a mass-complete sample of 418 galaxies within a wide wavelength coverage of 0.5-4.6${\mu}$m and a redshift window of 1<z<2. We find that a near-IR detection gives access to a larger set of clumps within galaxies, with those also detected in UV making up only 28%. Whereas, 85% of the UV clumps are found to have a near-IR counterpart. These near-IR clumps closely follow the UVJ classification of their respective host galaxies, with these hosts mainly populating the star-forming regime besides a fraction of them (16%) that can be considered quiescent. The mass of the detected clumps are found to be within the range of $10^{7.5-9.5}\,\rm M_{\odot}$, therefore expected to drive gas into galaxy cores through tidal torques. However, there is likely contribution from blending of smaller unresolved structures. Furthermore, we observe a radial gradient of increasing clump mass towards the centre of galaxies. This trend could be an indication of clump migration, but accurate star-formation measurements would be required to confirm such a scenario.


title: Large Language Models are Geographically Biased

abstract: Large Language Models (LLMs) inherently carry the biases contained in their training corpora, which can lead to the perpetuation of societal harm. As the impact of these foundation models grows, understanding and evaluating their biases becomes crucial to achieving fairness and accuracy. We propose to study what LLMs know about the world we live in through the lens of geography. This approach is particularly powerful as there is ground truth for the numerous aspects of human life that are meaningfully projected onto geographic space such as culture, race, language, politics, and religion. We show various problematic geographic biases, which we define as systemic errors in geospatial predictions. Initially, we demonstrate that LLMs are capable of making accurate zero-shot geospatial predictions in the form of ratings that show strong monotonic correlation with ground truth (Spearman's $\rho$ of up to 0.89). We then show that LLMs exhibit common biases across a range of objective and subjective topics. In particular, LLMs are clearly biased against locations with lower socioeconomic conditions (e.g. most of Africa) on a variety of sensitive subjective topics such as attractiveness, morality, and intelligence (Spearman's $\rho$ of up to 0.70). Finally, we introduce a bias score to quantify this and find that there is significant variation in the magnitude of bias across existing LLMs.


title: Equivariant Symmetry Breaking Sets

abstract: Equivariant neural networks (ENNs) have been shown to be extremely effective in applications involving underlying symmetries. By construction ENNs cannot produce lower symmetry outputs given a higher symmetry input. However, spontaneous symmetry breaking occurs in many physical systems and we may obtain a less symmetric stable state from an initial highly symmetric one. Hence, it is imperative that we understand how to systematically break symmetry in ENNs. In this work, we propose a novel symmetry breaking framework that is fully equivariant. We emphasize that our approach is general and applicable to equivariance under any group. To achieve this, we introduce the idea of symmetry breaking sets (SBS). Rather than redesign existing networks, we design sets of symmetry breaking objects which we feed into our network based on the symmetry of our inputs and outputs. We show there is a natural way to define equivariance on these sets, which gives an additional constraint. Minimizing the size of these sets equates to data efficiency. We prove that minimizing these sets translates to a well studied group theory problem, and tabulate solutions to this problem for the point groups. Finally, we provide some examples of symmetry breaking to demonstrate how our approach works in practice.


title: Holographic Thermal Mapping Using Acoustic Lenses

abstract: Acoustic holographic lenses (AHLs) show great potential for sound manipulation. These lenses store the phase and amplitude profile of the desired wavefront when illuminated by a single acoustic source to reconstruct focused ultrasound (FUS) pressure fields, induce localized heating, and achieve temporal and spatial thermal effects in acousto-thermal materials like polymers. The ultrasonic energy is transmitted and focused by AHL from a transducer into a particular focal volume. It is then converted to heat by internal friction in the polymer chains, causing the temperature of the polymer to rise at the focus locations while having little to no effect elsewhere. This one-of-a-kind capability is made possible by the development of AHLs to make use of the translation of attenuated pressure fields into programmable heat patterns. However, the acousto-thermal dynamics of AHLs are largely unexplored. We use a machine learning-assisted single inverse problem approach for rapid and efficient AHL designs. The process involves the conversion of thermal information into a holographic representation through the utilization of two latent functions; pressure phase and amplitude. Experimental verification is performed for pressure and thermal measurements. The volumetric acousto-thermal analysis of experimental samples is performed to offer knowledge of the obtained pattern dynamics, as well as the applicability of holographic FUS thermal mapping for precise temperature control in complex volumes of heterogeneous media. The proposed framework provides a solid foundation for anticipating and assessing thermal changes within materials using only outer surface measurements since it can correlate with surface temperature data alone.


title: Nonlinear potential theoretic methods in nonuniformly ellliptic problems

abstract: Nonuniform ellipticity is a classical topic in the theory of partial differential equations. While several results in regularity theory have been adding up over decades, many basic issues, as for instance the validity of Schauder theory and sharp dependence of regularity upon data, remained opened for a while. In these notes we give an overview of recent results and techniques about the topic, that, via a novel use of nonlinear potential theoretic methods, allow to answer several of the above questions.


title: Efficient estimation of subgroup treatment effects using multi-source data

abstract: Investigators often use multi-source data (e.g., multi-center trials, meta-analyses of randomized trials, pooled analyses of observational cohorts) to learn about the effects of interventions in subgroups of some well-defined target population. Such a target population can correspond to one of the data sources of the multi-source data or an external population in which the treatment and outcome information may not be available. We develop and evaluate methods for using multi-source data to estimate subgroup potential outcome means and treatment effects in a target population. We consider identifiability conditions and propose doubly robust estimators that, under mild conditions, are non-parametrically efficient and allow for nuisance functions to be estimated using flexible data-adaptive methods (e.g., machine learning techniques). We also show how to construct confidence intervals and simultaneous confidence bands for the estimated subgroup treatment effects. We examine the properties of the proposed estimators in simulation studies and compare performance against alternative estimators. We also conclude that our methods work well when the sample size of the target population is much larger than the sample size of the multi-source data. We illustrate the proposed methods in a meta-analysis of randomized trials for schizophrenia.


title: Intrinsic nonlinear Hall effect in two-dimensional honeycomb topological antiferromagnets

abstract: Two-dimensional systems with honeycomb lattice are known to be a paradigmatic platform to explore the various types of Hall effects, owing to that the interplay of lattice geometry, spin-orbit coupling and magnetism can give rise to very rich features in the quantum geometry of wave functions. In this work, we consider honeycomb topological antiferromagets that are effectively described by a $\mathcal{PT}$-symmetric antiferromagnetic Kane-Mele model, and explore the evolution of its nonlinear Hall response with respect to the change of lattice anisotropy, chemical potential, and the direction of the N\'{e}el vector. Due to the $\mathcal{PT}$-symmetry, the leading-order Hall effect of quantum geometric origin is the intrinsic nonlinear Hall effect, which is a second-order effect of electric fields and is independent of the scattering time. We investigate the behavior of the intrinsic nonlinear Hall conductivity tensor across topological phase transitions driven by antiferromagnetic exchange field and lattice anisotropy and find that its components do not change sign, which is different from the extrinsic nonlinear Hall effect. In the weakly doped regime, we find that the intrinsic nonlinear Hall effect is valley-polarized. By varying the chemical potential, we find that the nonlinear Hall conductivity tensors exhibit kinks when the Fermi surface undergoes Lifshitz transitions. Furthermore, we find that the existence of spin-orbit coupling to lift the spin-rotation symmetry is decisive for the use of intrinsic nonlinear Hall effect to detect the direction of the N\'{e}el vector. Our work shows that the two-dimensional honeycomb topological antiferromagnets are an ideal class of material systems with rich properties for the study of intrinsic nonlinear Hall effect.


title: Multi-Region Markovian Gaussian Process: An Efficient Method to Discover Directional Communications Across Multiple Brain Regions

abstract: Studying the complex interactions between different brain regions is crucial in neuroscience. Various statistical methods have explored the latent communication across multiple brain regions. Two main categories are the Gaussian Process (GP) and Linear Dynamical System (LDS), each with unique strengths. The GP-based approach effectively discovers latent variables with frequency bands and communication directions. Conversely, the LDS-based approach is computationally efficient but lacks powerful expressiveness in latent representation. In this study, we merge both methodologies by creating an LDS mirroring a multi-output GP, termed Multi-Region Markovian Gaussian Process (MRM-GP). Our work establishes a connection between an LDS and a multi-output GP that explicitly models frequencies and phase delays within the latent space of neural recordings. Consequently, the model achieves a linear inference cost over time points and provides an interpretable low-dimensional representation, revealing communication directions across brain regions and separating oscillatory communications into different frequency bands.


title: Poisson Process for Bayesian Optimization

abstract: BayesianOptimization(BO) is a sample-efficient black-box optimizer, and extensive methods have been proposed to build the absolute function response of the black-box function through a probabilistic surrogate model, including Tree-structured Parzen Estimator (TPE), random forest (SMAC), and Gaussian process (GP). However, few methods have been explored to estimate the relative rankings of candidates, which can be more robust to noise and have better practicality than absolute function responses, especially when the function responses are intractable but preferences can be acquired. To this end, we propose a novel ranking-based surrogate model based on the Poisson process and introduce an efficient BO framework, namely Poisson Process Bayesian Optimization (PoPBO). Two tailored acquisition functions are further derived from classic LCB and EI to accommodate it. Compared to the classic GP-BO method, our PoPBO has lower computation costs and better robustness to noise, which is verified by abundant experiments. The results on both simulated and real-world benchmarks, including hyperparameter optimization (HPO) and neural architecture search (NAS), show the effectiveness of PoPBO.


title: Successive Bayesian Reconstructor for FAS Channel Estimation

abstract: Fluid antenna systems (FASs) can reconfigure their locations freely within a spatially continuous space. To keep favorable antenna positions, the channel state information (CSI) acquisition for FASs is essential. While some techniques have been proposed, most existing FAS channel estimators require several channel assumptions, such as slow variation and angular-domain sparsity. When these assumptions are not reasonable, the model mismatch may lead to unpredictable performance loss. In this paper, we propose the successive Bayesian reconstructor (S-BAR) as a general solution to estimate FAS channels. Unlike model-based estimators, the proposed S-BAR is prior-aided, which builds the experiential kernel for CSI acquisition. Inspired by Bayesian regression, the key idea of S-BAR is to model the FAS channels as a stochastic process, whose uncertainty can be successively eliminated by kernel-based sampling and regression. In this way, the predictive mean of the regressed stochastic process can be viewed as the maximum a posterior (MAP) estimator of FAS channels. Simulation results verify that, in both model-mismatched and model-matched cases, the proposed S-BAR can achieve higher estimation accuracy than the existing schemes.


title: Planar Graphs with Homomorphisms to the 9-cycle

abstract: We study the problem of finding homomorphisms into odd cycles from planar graphs with high odd-girth. The Jaeger-Zhang conjecture states that every planar graph of odd-girth at least $4k+1$ admits a homomorphism to the odd cycle $C_{2k+1}$. The $k=1$ case is the well-known Gr\"otzsch's $3$-coloring theorem. For general $k$, in 2013 Lov\'asz, Thomassen, Wu, and Zhang showed that it suffices to have odd-girth at least $6k+1$. Improvements are known for $C_5$ and $C_7$ in [Combinatorica 2017, SIDMA 2020, Combinatorica 2022]. For $C_9$ we improve this hypothesis by showing that it suffices to have odd-girth 23. Our main tool is a variation on the potential method applied to modular orientations. This allows more flexibility when seeking reducible configurations. The same techniques also prove some results on circular coloring of signed planar graphs.


title: Competitive Equilibrium in Microgrids With Dynamic Loads

abstract: In this paper, we consider microgrids that interconnect prosumers with distributed energy resources and dynamic loads. Prosumers are connected through the microgrid to trade energy and gain profit while respecting the network constraints. We establish a local energy market by defining a competitive equilibrium which balances energy and satisfies voltage constraints within the microgrid for all time. Using duality theory, we prove that under some convexity assumptions, a competitive equilibrium is equivalent to a social welfare maximization solution. Additionally, we show that a competitive equilibrium is equivalent to a Nash equilibrium of a standard game. In general, the energy price for each prosumer is different, leading to the concept of locational prices. We investigate a case under which all prosumers have the same locational prices. Additionally, we show that under some assumptions on the resource supply and network topology, locational prices decay to zero after a period of time, implying the available supply will be more than the demand required to stabilize the system. Finally, two numerical examples are provided to validate the results, one of which is a direct application of our results on electric vehicle charging control.


title: ALIVE: A Low-Cost Interactive Vaccine Storage Environment Module ensuring easy portability and remote tracking of operational logistics to the last mile

abstract: The COVID-19 pandemic has profoundly reshaped our lives, prompting a search for solutions to its far-reaching effects. Vaccines emerged as a beacon of hope, yet reaching remote areas faces last-mile hurdles and cost issues due to loss of vaccine potency due to poor temperature regulation of the storage units and unanticipated vaccine wastage en route, a common occurrence in conventional vaccine transportation methods. We introduce ALIVE, a low-cost Interactive Vaccine Storage Environment module. ALIVE provides an off-grid, self-sufficient solution for vaccine storage and transport, enabled by active cooling technology. ALIVE's innovation lies in its integration with the Internet of Things (IoT), allowing real-time monitoring and control. This IoT-enabled Application Programming Interface (API) features a data acquisition and environment parameter control system, managing oversight and decision-making. ALIVE's compact, lightweight design makes it adaptable to various logistical scenarios, while its versatility enables it to maintain both time-invariant and time-dependent thermophysical and spatial parameters. Operationalized through a PID algorithm, ALIVE ensures precise temperature control within the vaccine chamber. Its dynamic features, such as remote actuation and data sharing, demonstrate its adaptability and potential applications. Despite the frugal nature of development, the system promises significant benefits, including reduced vaccine loss and remote monitoring advantages. Collaborations with healthcare partners seek to further enhance ALIVE's readiness and expand its impact. ALIVE revolutionizes vaccine logistics, offering scalable, cost-effective solutions for bridging accessibility gaps in challenging distribution scenarios. Its adaptability positions it for widespread application, from last-mile vaccine delivery to environment-controlled supply chains and beyond.


title: Statistical Guarantees for Link Prediction using Graph Neural Networks

abstract: This paper derives statistical guarantees for the performance of Graph Neural Networks (GNNs) in link prediction tasks on graphs generated by a graphon. We propose a linear GNN architecture (LG-GNN) that produces consistent estimators for the underlying edge probabilities. We establish a bound on the mean squared error and give guarantees on the ability of LG-GNN to detect high-probability edges. Our guarantees hold for both sparse and dense graphs. Finally, we demonstrate some of the shortcomings of the classical GCN architecture, as well as verify our results on real and synthetic datasets.


title: On Recurrence Axioms

abstract: The Recurrence Axiom for a class $\mathcal{P}$ of \pos\ and a set $A$ of parameters is an axiom scheme in the language of ZFC asserting that if a statement with parameters from $A$ is forced by a poset in $\mathcal{P}$, then there is a ground containing the parameters and satisfying the statement. The tightly super-$C^{(\infty)}$-$\mathcal{P}$-Laver generic hyperhuge continuum implies the Recurrence Axiom for $\mathcal{P}$ and $\mathcal{H}(2^{\aleph_0})$. The consistency strength of this assumption can be decided thanks to our main theorems asserting that the minimal ground (bedrock) exists under a tightly $\mathcal{P}$-generic hyperhuge cardinal $\kappa$, and that $\kappa$ in the bedrock is genuinely hyperhuge, or even super $C^{(\infty)}$ hyperhuge if $\kappa$ is a tightly super-$C^{(\infty)}$-$\mathcal{P}$-Laver generic hyperhuge definable cardinal. The Laver Generic Maximum (LGM), one of the strongest combinations of axioms in our context, integrates practically all known set-theoretic principles and axioms in itself, either as its consequences or as theorems holding in (many) grounds of the universe. For example, double plus version of Martin's Maximum is a consequence of LGM while Cicho\'n's Maximum is a phenomenon in many grounds of the universe under LGM.


title: Description on IEEE ICME 2024 Grand Challenge: Semi-supervised Acoustic Scene Classification under Domain Shift

abstract: Acoustic scene classification (ASC) is a crucial research problem in computational auditory scene analysis, and it aims to recognize the unique acoustic characteristics of an environment. One of the challenges of the ASC task is the domain shift between training and testing data. Since 2018, ASC challenges have focused on the generalization of ASC models across different recording devices. Although this task, in recent years, has achieved substantial progress in device generalization, the challenge of domain shift between different geographical regions, involving discrepancies such as time, space, culture, and language, remains insufficiently explored at present. In addition, considering the abundance of unlabeled acoustic scene data in the real world, it is important to study the possible ways to utilize these unlabelled data. Therefore, we introduce the task Semi-supervised Acoustic Scene Classification under Domain Shift in the ICME 2024 Grand Challenge. We encourage participants to innovate with semi-supervised learning techniques, aiming to develop more robust ASC models under domain shift.


title: Exploiting Class Probabilities for Black-box Sentence-level Attacks

abstract: Sentence-level attacks craft adversarial sentences that are synonymous with correctly-classified sentences but are misclassified by the text classifiers. Under the black-box setting, classifiers are only accessible through their feedback to queried inputs, which is predominately available in the form of class probabilities. Even though utilizing class probabilities results in stronger attacks, due to the challenges of using them for sentence-level attacks, existing attacks use either no feedback or only the class labels. Overcoming the challenges, we develop a novel algorithm that uses class probabilities for black-box sentence-level attacks, investigate the effectiveness of using class probabilities on the attack's success, and examine the question if it is worthy or practical to use class probabilities by black-box sentence-level attacks. We conduct extensive evaluations of our attack comparing with the baselines across various classifiers and benchmark datasets.


title: Causal Feature Selection for Responsible Machine Learning

abstract: Machine Learning (ML) has become an integral aspect of many real-world applications. As a result, the need for responsible machine learning has emerged, focusing on aligning ML models to ethical and social values, while enhancing their reliability and trustworthiness. Responsible ML involves many issues. This survey addresses four main issues: interpretability, fairness, adversarial robustness, and domain generalization. Feature selection plays a pivotal role in the responsible ML tasks. However, building upon statistical correlations between variables can lead to spurious patterns with biases and compromised performance. This survey focuses on the current study of causal feature selection: what it is and how it can reinforce the four aspects of responsible ML. By identifying features with causal impacts on outcomes and distinguishing causality from correlation, causal feature selection is posited as a unique approach to ensuring ML models to be ethically and socially responsible in high-stakes applications.


title: Deep Equilibrium Models are Almost Equivalent to Not-so-deep Explicit Models for High-dimensional Gaussian Mixtures

abstract: Deep equilibrium models (DEQs), as a typical implicit neural network, have demonstrated remarkable success on various tasks. There is, however, a lack of theoretical understanding of the connections and differences between implicit DEQs and explicit neural network models. In this paper, leveraging recent advances in random matrix theory (RMT), we perform an in-depth analysis on the eigenspectra of the conjugate kernel (CK) and neural tangent kernel (NTK) matrices for implicit DEQs, when the input data are drawn from a high-dimensional Gaussian mixture. We prove, in this setting, that the spectral behavior of these Implicit-CKs and NTKs depend on the DEQ activation function and initial weight variances, but only via a system of four nonlinear equations. As a direct consequence of this theoretical result, we demonstrate that a shallow explicit network can be carefully designed to produce the same CK or NTK as a given DEQ. Despite derived here for Gaussian mixture data, empirical results show the proposed theory and design principle also apply to popular real-world datasets.


title: Beyond Expectations: Learning with Stochastic Dominance Made Practical

abstract: Stochastic dominance models risk-averse preferences for decision making with uncertain outcomes, which naturally captures the intrinsic structure of the underlying uncertainty, in contrast to simply resorting to the expectations. Despite theoretically appealing, the application of stochastic dominance in machine learning has been scarce, due to the following challenges: $\textbf{i)}$, the original concept of stochastic dominance only provides a $\textit{partial order}$, therefore, is not amenable to serve as an optimality criterion; and $\textbf{ii)}$, an efficient computational recipe remains lacking due to the continuum nature of evaluating stochastic dominance.%, which barriers its application for machine learning. In this work, we make the first attempt towards establishing a general framework of learning with stochastic dominance. We first generalize the stochastic dominance concept to enable feasible comparisons between any arbitrary pair of random variables. We next develop a simple and computationally efficient approach for finding the optimal solution in terms of stochastic dominance, which can be seamlessly plugged into many learning tasks. Numerical experiments demonstrate that the proposed method achieves comparable performance as standard risk-neutral strategies and obtains better trade-offs against risk across a variety of applications including supervised learning, reinforcement learning, and portfolio optimization.


title: Adversarial Data Augmentation for Robust Speaker Verification

abstract: Data augmentation (DA) has gained widespread popularity in deep speaker models due to its ease of implementation and significant effectiveness. It enriches training data by simulating real-life acoustic variations, enabling deep neural networks to learn speaker-related representations while disregarding irrelevant acoustic variations, thereby improving robustness and generalization. However, a potential issue with the vanilla DA is augmentation residual, i.e., unwanted distortion caused by different types of augmentation. To address this problem, this paper proposes a novel approach called adversarial data augmentation (A-DA) which combines DA with adversarial learning. Specifically, it involves an additional augmentation classifier to categorize various augmentation types used in data augmentation. This adversarial learning empowers the network to generate speaker embeddings that can deceive the augmentation classifier, making the learned speaker embeddings more robust in the face of augmentation variations. Experiments conducted on VoxCeleb and CN-Celeb datasets demonstrate that our proposed A-DA outperforms standard DA in both augmentation matched and mismatched test conditions, showcasing its superior robustness and generalization against acoustic variations.


title: Sample Complexity Characterization for Linear Contextual MDPs

abstract: Contextual Markov decision processes (CMDPs) describe a class of reinforcement learning problems in which the transition kernels and reward functions can change over time with different MDPs indexed by a context variable. While CMDPs serve as an important framework to model many real-world applications with time-varying environments, they are largely unexplored from theoretical perspective. In this paper, we study CMDPs under two linear function approximation models: Model I with context-varying representations and common linear weights for all contexts; and Model II with common representations for all contexts and context-varying linear weights. For both models, we propose novel model-based algorithms and show that they enjoy guaranteed $\epsilon$-suboptimality gap with desired polynomial sample complexity. In particular, instantiating our result for the first model to the tabular CMDP improves the existing result by removing the reachability assumption. Our result for the second model is the first-known result for such a type of function approximation models. Comparison between our results for the two models further indicates that having context-varying features leads to much better sample efficiency than having common representations for all contexts under linear CMDPs.


title: Understanding What Affects Generalization Gap in Visual Reinforcement Learning: Theory and Empirical Evidence

abstract: Recently, there are many efforts attempting to learn useful policies for continuous control in visual reinforcement learning (RL). In this scenario, it is important to learn a generalizable policy, as the testing environment may differ from the training environment, e.g., there exist distractors during deployment. Many practical algorithms are proposed to handle this problem. However, to the best of our knowledge, none of them provide a theoretical understanding of what affects the generalization gap and why their proposed methods work. In this paper, we bridge this issue by theoretically answering the key factors that contribute to the generalization gap when the testing environment has distractors. Our theories indicate that minimizing the representation distance between training and testing environments, which aligns with human intuition, is the most critical for the benefit of reducing the generalization gap. Our theoretical results are supported by the empirical evidence in the DMControl Generalization Benchmark (DMC-GB).


title: Causal inference under transportability assumptions for conditional relative effect measures

abstract: When extending inferences from a randomized trial to a new target population, an assumption of transportability of difference effect measures (e.g., conditional average treatment effects) -- or even stronger assumptions of transportability in expectation or distribution of potential outcomes -- is invoked to identify the marginal causal mean difference in the target population. However, many clinical investigators believe that relative effect measures conditional on covariates, such as conditional risk ratios and mean ratios, are more likely to be ``transportable'' across populations compared with difference effect measures. Here, we examine the identification and estimation of the marginal counterfactual mean difference and ratio under a transportability assumption for conditional relative effect measures. We obtain identification results for two scenarios that often arise in practice when individuals in the target population (1) only have access to the control treatment, or (2) have access to the control and other treatments but not necessarily the experimental treatment evaluated in the trial. We then propose multiply robust and nonparametric efficient estimators that allow for the use of data-adaptive methods (e.g., machine learning techniques) to model the nuisance parameters. We examine the performance of the methods in simulation studies and illustrate their use with data from two trials of paliperidone for patients with schizophrenia. We conclude that the proposed methods are attractive when background knowledge suggests that the transportability assumption for conditional relative effect measures is more plausible than alternative assumptions.


title: Production of open-charm pentaquark molecules in decay $B^0 \rightarrow \bar{D}^0 p \bar{p}$

abstract: This study explores the production of open-charm pentaquark molecular states, specifically $N\bar{D}^*$ and $\bar{N}\bar{D}^*$, within the $B^0 \rightarrow \bar{D}^0 p \bar{p}$ decay process. We analyze the invariant mass spectrum of $p\bar{D}^0$ and $\bar{p}\bar{D}^0$, incorporating the rescattering process calculated using a quasipotential Bethe-Salpeter equation approach. Our findings suggest the potential identification of the isoscalar $\bar{N}\bar{D}^*$ molecule with $3/2^+$, serving as the antiparticle partner of the $\Lambda_c(2940)$, in the $\bar{p}\bar{D}^0$ mass distribution. Additionally, distinctive signals of the isovector $N\bar{D}^*$ molecule with $1/2^-$ may emerge in the $p\bar{D}^0$ invariant mass distribution. We highlight the significance of the three-body decay of the bottom meson as a valuable avenue for studying open-charm molecules and advocate for increased attention and more precise experimental measurements of the $B^0 \rightarrow \bar{D}^0 p \bar{p}$ process.


title: Knowledge-driven deep learning for fast MR imaging: undersampled MR image reconstruction from supervised to un-supervised learning

abstract: Deep learning (DL) has emerged as a leading approach in accelerating MR imaging. It employs deep neural networks to extract knowledge from available datasets and then applies the trained networks to reconstruct accurate images from limited measurements. Unlike natural image restoration problems, MR imaging involves physics-based imaging processes, unique data properties, and diverse imaging tasks. This domain knowledge needs to be integrated with data-driven approaches. Our review will introduce the significant challenges faced by such knowledge-driven DL approaches in the context of fast MR imaging along with several notable solutions, which include learning neural networks and addressing different imaging application scenarios. The traits and trends of these techniques have also been given which have shifted from supervised learning to semi-supervised learning, and finally, to unsupervised learning methods. In addition, MR vendors' choices of DL reconstruction have been provided along with some discussions on open questions and future directions, which are critical for the reliable imaging systems.


title: Representation Surgery for Multi-Task Model Merging

abstract: Multi-task learning (MTL) compresses the information from multiple tasks into a unified backbone to improve computational efficiency and generalization. Recent work directly merges multiple independently trained models to perform MTL instead of collecting their raw data for joint training, greatly expanding the application scenarios of MTL. However, by visualizing the representation distribution of existing model merging schemes, we find that the merged model often suffers from the dilemma of representation bias. That is, there is a significant discrepancy in the representation distribution between the merged and individual models, resulting in poor performance of merged MTL. In this paper, we propose a representation surgery solution called "Surgery" to reduce representation bias in the merged model. Specifically, Surgery is a lightweight task-specific module that takes the representation of the merged model as input and attempts to output the biases contained in the representation from the merged model. We then designed an unsupervised optimization objective that updates the Surgery module by minimizing the distance between the merged model's representation and the individual model's representation. Extensive experiments demonstrate significant MTL performance improvements when our Surgery module is applied to state-of-the-art (SOTA) model merging schemes.


title: Cloudlet Capture Model for the Accretion Streamer onto the disk of DG Tau

abstract: DG Tau is a nearby T Tauri star associated with a collimated jet, a circumstellar disk and a streamer a few hundred au long. The streamer connects to the disk at $\sim$50 au from DG Tau. At this location SO emission is observed, likely due to the release of sulphur from dust grains caused by the shock of the impact of the accretion streamer onto the disk. We investigate the possibility that the DG Tau streamer was produced via cloudlet capture on the basis of hydrodynamic simulations, considering a cloudlet initiating infall at 600 au from DG Tau with low angular momentum so that the centrifugal force is smaller than the gravitational force, even at 50 au. The elongation of the cloudlet into a streamer is caused by the tidal force when its initial velocity is much less than the free-fall velocity. The elongated cloudlet reaches the disk and forms a high density gas clump. Our hydrodynamic model reproduces the morphology and line-of-sight velocity of CS ($5-4$) emission from the Northern streamer observed with ALMA. We discuss the conditions for forming a streamer based on the simulations. We also show that the streamer should perturb the disk after impact for several thousands of years.


title: Dielectrics for Two-Dimensional Transition Metal Dichalcogenide Applications

abstract: Despite over a decade of intense research efforts, the full potential of two-dimensional transition metal dichalcogenides continues to be limited by major challenges. The lack of compatible and scalable dielectric materials and integration techniques restrict device performances and their commercial applications Conventional dielectric integration techniques for bulk semiconductors are difficult to adapt for atomically thin two-dimensional materials. This review provides a brief introduction into various common and emerging dielectric synthesis and integration techniques and discusses their applicability for 2D transition metal dichalcogenides. Dielectric integration for various applications is reviewed in subsequent sections including nanoelectronics, optoelectronics, flexible electronics, valleytronics, biosensing, quantum information processing, and quantum sensing. For each application, we introduce basic device working principles, discuss the specific dielectric requirements, review current progress, present key challenges, and offer insights into future prospects and opportunities.


title: CRANE: A Redundant, Multi-Degree-of-Freedom Computed Tomography Robot for Heightened Needle Dexterity within a Medical Imaging Bore

abstract: Computed Tomography (CT) image guidance enables accurate and safe minimally invasive treatment of diseases, including cancer and chronic pain, with needle-like tools via a percutaneous approach. The physician incrementally inserts and adjusts the needle with intermediate images due to the accuracy limitation of free-hand adjustment and patient physiological motion. Scanning frequency is limited to minimize ionizing radiation exposure for the patient and physician. Robots can provide high positional accuracy and compensate for physiological motion with fewer scans. To accomplish this, the robots must operate within the confined imaging bore while retaining sufficient dexterity to insert and manipulate the needle. This paper presents CRANE: CT Robotic Arm and Needle Emplacer, a CT-compatible robot with a design focused on system dexterity that enables physicians to manipulate and insert needles within the scanner bore as naturally as they would be able to by hand. We define abstract and measurable clinically motivated metrics for in-bore dexterity applicable to general-purpose intra-bore image-guided needle placement robots, develop an automatic robot planning and control method for intra-bore needle manipulation and device setup, and demonstrate the redundant linkage design provides dexterity across various human morphology and meets the clinical requirements for target accuracy during an in-situ evaluation.


title: Passive decoy-state quantum secure direct communication with heralded single-photon source

abstract: Quantum secure direct communications (QSDC) can directly transmit secret messages through quantum channel without keys. The imperfect photon source is a major obstacle for QSDC's practical implementation. The unwanted vacuum state and multi-photon components emitted from imperfect photon source largely reduce QSDC's secrecy message capacity and even threaten its security. In the paper, we propose a high-efficient passive decoy-state QSDC protocol with the heralded single-photon source (HSPS). We adopt a spontaneous parametric down-conversion source to emit entangled photon pairs in two spatial modes. By detecting the photons in one of the two correlated spatial modes, we can infer the photon number distribution of the other spatial mode. Meanwhile, our protocol allows a simple passive preparation of the signal states and decoy state. The HSPS can effectively reduce the probability of vacuum state and increase QSDC's secrecy message capacity. Meanwhile, the passive decoy-state method can simplify the experimental operations and enhance QSDC's robustness against the third-party side-channel attacks. Under the communication distance of 10 km, the secrecy message capacity of our QSDC protocol can achieve 81.85 times (average photon number of 0.1) and 12.79 times (average photon number of 0.01) of that in the original single-photon-based QSDC protocol without the HSPS. Our QSDC protocol has longer maximal communication distance (about 17.975 km with average photon number of 0.01). Our work serves as a major step toward the further development of practical passive decoy-state QSDC systems.


title: Entangling two exciton modes using exciton optomechanics

abstract: Exciton optomechanics, bridging cavity exciton polaritons and optomechanics, opens new opportunities for the study of light-matter strong interactions and nonlinearities, due to the rich nonlinear couplings among excitons, phonons, and photons. Here, we propose to entangle two exciton modes in an exciton-optomechanical system, which consists of a semiconductor optomechanical microcavity integrated with two quantum wells. The quantum wells support two exciton modes, which simultaneously couple to an optical cavity mode via a linear coupling, and the cavity mode also couples to a mechanical vibration mode via a dispersive optomechanical interaction, accounting for both the radiation pressure and the photoelastic effect. We show that by strongly driving the microcavity with a red-detuned laser field and when the two exciton modes are respectively resonant with the Stokes and anti-Stokes sidebands scattered by the mechanical motion, stationary entanglement between the two exciton modes can be established under currently available parameters. The entanglement is robust against various dissipations of the system and can be achieved at room temperature for a mechanical quality factor higher than $\sim10^4$.


title: Architectural Strategies for the optimization of Physics-Informed Neural Networks

abstract: Physics-informed neural networks (PINNs) offer a promising avenue for tackling both forward and inverse problems in partial differential equations (PDEs) by incorporating deep learning with fundamental physics principles. Despite their remarkable empirical success, PINNs have garnered a reputation for their notorious training challenges across a spectrum of PDEs. In this work, we delve into the intricacies of PINN optimization from a neural architecture perspective. Leveraging the Neural Tangent Kernel (NTK), our study reveals that Gaussian activations surpass several alternate activations when it comes to effectively training PINNs. Building on insights from numerical linear algebra, we introduce a preconditioned neural architecture, showcasing how such tailored architectures enhance the optimization process. Our theoretical findings are substantiated through rigorous validation against established PDEs within the scientific literature.


title: Unconditionally energy stable IEQ-FEMs for the Cahn-Hilliard equation and Allen-Cahn equation

abstract: In this paper, we present several unconditionally energy-stable invariant energy quadratization (IEQ) finite element methods (FEMs) with linear, first- and second-order accuracy for solving both the Cahn-Hilliard equation and the Allen-Cahn equation. For time discretization, we compare three distinct IEQ-FEM schemes that position the intermediate function introduced by the IEQ approach in different function spaces: finite element space, continuous function space, or a combination of these spaces. Rigorous proofs establishing the existence and uniqueness of the numerical solution, along with analyses of energy dissipation for both equations and mass conservation for the Cahn-Hilliard equation, are provided. The proposed schemes' accuracy, efficiency, and solution properties are demonstrated through numerical experiments.


title: Position: What Can Large Language Models Tell Us about Time Series Analysis

abstract: Time series analysis is essential for comprehending the complexities inherent in various realworld systems and applications. Although large language models (LLMs) have recently made significant strides, the development of artificial general intelligence (AGI) equipped with time series analysis capabilities remains in its nascent phase. Most existing time series models heavily rely on domain knowledge and extensive model tuning, predominantly focusing on prediction tasks. In this paper, we argue that current LLMs have the potential to revolutionize time series analysis, thereby promoting efficient decision-making and advancing towards a more universal form of time series analytical intelligence. Such advancement could unlock a wide range of possibilities, including time series modality switching and question answering. We encourage researchers and practitioners to recognize the potential of LLMs in advancing time series analysis and emphasize the need for trust in these related efforts. Furthermore, we detail the seamless integration of time series analysis with existing LLM technologies and outline promising avenues for future research.


title: Neural option pricing for rough Bergomi model

abstract: The rough Bergomi (rBergomi) model can accurately describe the historical and implied volatilities, and has gained much attention in the past few years. However, there are many hidden unknown parameters or even functions in the model. In this work, we investigate the potential of learning the forward variance curve in the rBergomi model using a neural SDE. To construct an efficient solver for the neural SDE, we propose a novel numerical scheme for simulating the volatility process using the modified summation of exponentials. Using the Wasserstein 1-distance to define the loss function, we show that the learned forward variance curve is capable of calibrating the price process of the underlying asset and the price of the European-style options simultaneously. Several numerical tests are provided to demonstrate its performance.


title: Table-Top Tunable Chiral Photonic Emitter

abstract: The increasing interest in chiral light stems from its spiral trajectory along the propagation direction, facilitating the interaction between different polarization states of light and matter. Despite tremendous achievements in chiral light-related research, the generation and control of chiral pulse have presented enduring challenges, especially at the terahertz and ultraviolet spectral ranges, due to the lack of suitable optical elements for effective pulse manipulation. Conventionally, chiral light can be obtained from intricate optical systems, by an external magnetic field, or by metamaterials, which necessitate sophisticated optical configurations. Here, we propose a versatile tunable chiral emitter, composed of only two planar Weyl semimetals slabs, addressing the challenges in both spectral ranges. Our results open the way to a compact tunable chiral emitter platform in both terahertz and ultra-violet frequency ranges. This advancement holds the potential to serve as the cornerstone for integrated chiral photonics.


title: Understanding the planning of LLM agents: A survey

abstract: As Large Language Models (LLMs) have shown significant intelligence, the progress to leverage LLMs as planning modules of autonomous agents has attracted more attention. This survey provides the first systematic view of LLM-based agents planning, covering recent works aiming to improve planning ability. We provide a taxonomy of existing works on LLM-Agent planning, which can be categorized into Task Decomposition, Plan Selection, External Module, Reflection and Memory. Comprehensive analyses are conducted for each direction, and further challenges for the field of research are discussed.


title: Minimal grid diagrams of the prime knots with crossing number 13 and arc index 13

abstract: We give a list of minimal grid diagrams of the 13 crossing prime nonalternating knots which have arc index 13. There are 9,988 prime knots with crossing number 13. Among them 4,878 are alternating and have arc index 15. Among the other nonalternating knots, 49, 399, 1,412 and 3,250 have arc index 10, 11, 12, and 13, respectively. We used the Dowker-Thistlethwaite code of the 3,250 knots provided by the program Knotscape to generate spanning trees of the corresponding knot diagrams to obtain minimal arc presentations in the form of grid diagrams.


title: Denoising Time Cycle Modeling for Recommendation

abstract: Recently, modeling temporal patterns of user-item interactions have attracted much attention in recommender systems. We argue that existing methods ignore the variety of temporal patterns of user behaviors. We define the subset of user behaviors that are irrelevant to the target item as noises, which limits the performance of target-related time cycle modeling and affect the recommendation performance. In this paper, we propose Denoising Time Cycle Modeling (DiCycle), a novel approach to denoise user behaviors and select the subset of user behaviors that are highly related to the target item. DiCycle is able to explicitly model diverse time cycle patterns for recommendation. Extensive experiments are conducted on both public benchmarks and a real-world dataset, demonstrating the superior performance of DiCycle over the state-of-the-art recommendation methods.


title: Budget-feasible Egalitarian Allocation of Conflicting Jobs

abstract: Allocating conflicting jobs among individuals while respecting a budget constraint for each individual is an optimization problem that arises in various real-world scenarios. In this paper, we consider the situation where each individual derives some satisfaction from each job. We focus on finding a feasible allocation of conflicting jobs that maximize egalitarian cost, i.e. the satisfaction of the \nc{individual who is worst-off}. To the best of our knowledge, this is the first paper to combine egalitarianism, budget-feasibility, and conflict-freeness in allocations. We provide a systematic study of the computational complexity of finding budget-feasible conflict-free egalitarian allocation and show that our problem generalizes a large number of classical optimization problems. Therefore, unsurprisingly, our problem is \NPH even for two individuals and when there is no conflict between any jobs. We show that the problem admits algorithms when studied in the realm of approximation algorithms and parameterized algorithms with a host of natural parameters that match and in some cases improve upon the running time of known algorithms.


title: Discounted Adaptive Online Learning: Towards Better Regularization

abstract: We study online learning in adversarial nonstationary environments. Since the future can be very different from the past, a critical challenge is to gracefully forget the history while new data comes in. To formalize this intuition, we revisit the discounted regret in online convex optimization, and propose an adaptive (i.e., instance optimal), FTRL-based algorithm that improves the widespread non-adaptive baseline -- gradient descent with a constant learning rate. From a practical perspective, this refines the classical idea of regularization in lifelong learning: we show that designing good regularizers can be guided by the principled theory of adaptive online optimization. Complementing this result, we also consider the (Gibbs and Cand\`es, 2021)-style online conformal prediction problem, where the goal is to sequentially predict the uncertainty sets of a black-box machine learning model. We show that the FTRL nature of our algorithm can simplify the conventional gradient-descent-based analysis, leading to instance-dependent performance guarantees.


title: Quantum Switches for Gottesman-Kitaev-Preskill Qubit-based All-Photonic Quantum Networks

abstract: The Gottesman-Kitaev-Preskill (GKP) code, being information theoretically near optimal for quantum communication over Gaussian thermal-loss optical channels, is likely to be the encoding of choice for advanced quantum networks of the future. Quantum repeaters based on GKP-encoded light have been shown to support high end-to-end entanglement rates across large distances despite realistic finite squeezing in GKP code preparation and homodyne detection inefficiencies. Here, we introduce a quantum switch for GKP-qubit-based quantum networks, whose architecture involves multiplexed GKP-qubit-based entanglement link generation with clients, and their all-photonic storage, together enabled by GKP-qubit graph state resources. For bipartite entanglement distribution between clients via entanglement swapping, the switch uses a multi-client generalization of a recently introduced $\textit{entanglement-ranking-based link matching}$ protocol heuristic. Since generating the GKP-qubit graph state resource is hardware intensive, given a total resource budget and an arbitrary layout of clients, we address the question of their optimal allocation towards the different client-pair connections served by the switch such that the sum throughput of the switch is maximized while also being fair in terms of the individual entanglement rates. We illustrate our results for an exemplary data center network, where the data center is a client of a switch and all of its other clients aim to connect to the data center alone -- a scenario that also captures the general case of a gateway router connecting a local area network to a global network. Together with compatible quantum repeaters, our quantum switch provides a way to realize quantum networks of arbitrary topology.


title: Dilatonic Geometrodynamics of a Two-Dimensional Curved Surface due to a Quantum Mechanically Confined Particle

abstract: We provide a unique and novel extension of da Costa's calculation of a quantum mechanically constrained particle by analyzing the perturbative back reaction of the quantum confined particle's eigenstates and spectra upon the geometry of the curved surface itself. We do this by first formulating a two dimensional action principle of the quantum constrained particle, which upon wave function variation reproduces Schr\"odinger's equation including da Costa's surface curvature induced potentials. Given this action principle, we vary its functional with respect to the embedded two dimensional inverse-metric to obtain the respective geometrodynamical Einstein equation. We solve this resulting Einstein equation perturbatively by first solving the da Costa's Schr\"odinger equation to obtain an initial eigensystem, which is used as initial-input data for a perturbed metric inserted into the derived Einstein equation. As a proof of concept, we perform this calculation on a two-sphere and show its first iterative perturbed shape. We also include the back reaction of a constant external magnetic field in a separate calculation. The geometrodynamical analysis is performed within a two dimensional dilation gravity analog, due to several computational advantages.


title: Beating one bit of communication with quantum correlations in smaller dimensions

abstract: As a consequence of Bell's theorem, the statistics of measurements on some entangled states cannot be simulated with local hidden variables alone. The amount of communication that must be supplied is an intuitive quantifier of nonclassicality. While it is obvious that this amount can be very large in general, it has been surprisingly difficult to find simple examples of quantum correlations, whose simulation requires more than one bit of communication. In this paper, we report the simplest example to date, which lives in the $(5,2,5,5)$ Bell scenario [the previously known smallest case living in the $(7,3,16,16)$ scenario]. The proof is built on the observation that finding the largest 1-bit score is equivalent to finding the bipartition of the inputs, in which the sum of the local scores of the two subgames is maximal.


title: FDNet: Frequency Domain Denoising Network For Cell Segmentation in Astrocytes Derived From Induced Pluripotent Stem Cells

abstract: Artificially generated induced pluripotent stem cells (iPSCs) from somatic cells play an important role for disease modeling and drug screening of neurodegenerative diseases. Astrocytes differentiated from iPSCs are important targets to investigate neuronal metabolism. The astrocyte differentiation progress can be monitored through the variations of morphology observed from microscopy images at different differentiation stages, then determined by molecular biology techniques upon maturation. However, the astrocytes usually ``perfectly'' blend into the background and some of them are covered by interference information (i.e., dead cells, media sediments, and cell debris), which makes astrocytes difficult to observe. Due to the lack of annotated datasets, the existing state-of-the-art deep learning approaches cannot be used to address this issue. In this paper, we introduce a new task named astrocyte segmentation with a novel dataset, called IAI704, which contains 704 images and their corresponding pixel-level annotation masks. Moreover, a novel frequency domain denoising network, named FDNet, is proposed for astrocyte segmentation. In detail, our FDNet consists of a contextual information fusion module (CIF), an attention block (AB), and a Fourier transform block (FTB). CIF and AB fuse multi-scale feature embeddings to localize the astrocytes. FTB transforms feature embeddings into the frequency domain and conducts a high-pass filter to eliminate interference information. Experimental results demonstrate the superiority of our proposed FDNet over the state-of-the-art substitutes in astrocyte segmentation, shedding insights for iPSC differentiation progress prediction.


title: Cybersickness Detection through Head Movement Patterns: A Promising Approach

abstract: Despite the widespread adoption of Virtual Reality (VR) technology, cybersickness remains a barrier for some users. This research investigates head movement patterns as a novel physiological marker for cybersickness detection. Unlike traditional markers, head movements provide a continuous, non-invasive measure that can be easily captured through the sensors embedded in all commercial VR headsets. We used a publicly available dataset from a VR experiment involving 75 participants and analyzed head movements across six axes. An extensive feature extraction process was then performed on the head movement dataset and its derivatives, including velocity, acceleration, and jerk. Three categories of features were extracted, encompassing statistical, temporal, and spectral features. Subsequently, we employed the Recursive Feature Elimination method to select the most important and effective features. In a series of experiments, we trained a variety of machine learning algorithms. The results demonstrate a 76% accuracy and 83% precision in predicting cybersickness in the subjects based on the head movements. This study contribution to the cybersickness literature lies in offering a preliminary analysis of a new source of data and providing insight into the relationship of head movements and cybersickness.


title: How do software practitioners perceive human-centric defects?

abstract: Context: Human-centric software design and development focuses on how users want to carry out their tasks rather than making users accommodate their software. Software users can have different genders, ages, cultures, languages, disabilities, socioeconomic statuses, and educational backgrounds, among many other differences. Due to the inherently varied nature of these differences and their impact on software usage, preferences and issues of users can vary, resulting in user-specific defects that we term as `human-centric defects' (HCDs). Objective: This research aims to understand the perception and current management practices of such human-centric defects by software practitioners, identify key challenges in reporting, understanding and fixing them, and provide recommendations to improve HCDs management in software engineering. Method: We conducted a survey and interviews with software engineering practitioners to gauge their knowledge and experience on HCDs and the defect tracking process. Results: We analysed fifty (50) survey- and ten (10) interview- responses from SE practitioners and identified that there are multiple gaps in the current management of HCDs in software engineering practice. There is a lack of awareness regarding human-centric aspects, causing them to be lost or under-appreciated during software development. Our results revealed that handling HCDs could be improved by following a better feedback process with end-users, a more descriptive taxonomy, and suitable automation. Conclusion: HCDs present a major challenge to software practitioners, given their diverse end-user base. In the software engineering domain, research on HCDs has been limited and requires effort from the research and practice communities to create better awareness and support regarding human-centric aspects.


title: A Local Projection Stabilised HHO Method for the Oseen Problem

abstract: Fluid flow problems with high Reynolds number show spurious oscillations in their solution when solved using standard Galerkin finite element methods. These Oscillations can be eradicated using various stabilisation techniques. In this article, we use a local projection stabilisation for a Hybrid High-Order approximation of the Oseen problem. We prove an existence-uniqueness result under a SUPG-like norm. We derive an optimal order error estimate under this norm for equal order polynomial discretisation of velocity and pressure spaces.


title: The SAMI Galaxy Survey: Using Tidal Streams and Shells to Trace the Dynamical Evolution of Massive Galaxies

abstract: Slow rotator galaxies are distinct amongst galaxy populations, with simulations suggesting that a mix of minor and major mergers are responsible for their formation. A promising path to resolve outstanding questions on the type of merger responsible, is by investigating deep imaging of massive galaxies for signs of potential merger remnants. We utilise deep imaging from the Subaru-Hyper Suprime Cam Wide data to search for tidal features in massive ($\log_{10}(M_*/M_{\odot}) > 10$) early-type galaxies (ETGs) in the SAMI Galaxy Survey. We perform a visual check for tidal features on images where the galaxy has been subtracted using a Multi-Gauss Expansion (MGE) model. We find that $31\pm 2$ percent of our sample show tidal features. When comparing galaxies with and without features, we find that the distributions in stellar mass, light-weighted mean stellar population age and H$\alpha$ equivalent width are significantly different, whereas spin ($\lambda_{R_e}$), ellipticity and bulge to total ratio have similar distributions. When splitting our sample in age, we find that galaxies below the median age (10.8 Gyr) show a correlation between the presence of shells and lower $\lambda_{R_e}$, as expected from simulations. We also find these younger galaxies which are classified as having "strong" shells have lower $\lambda_{R_e}$. However, simulations suggest that merger features become undetectable within $\sim 2-4$ Gyr post-merger. This implies that the relationship between tidal features and merger history disappears for galaxies with older stellar ages, i.e. those that are more likely to have merged long ago.


title: Fast and Accurate Cooperative Radio Map Estimation Enabled by GAN

abstract: In the 6G era, real-time radio resource monitoring and management are urged to support diverse wireless-empowered applications. This calls for fast and accurate estimation on the distribution of the radio resources, which is usually represented by the spatial signal power strength over the geographical environment, known as a radio map. In this paper, we present a cooperative radio map estimation (CRME) approach enabled by the generative adversarial network (GAN), called as GAN-CRME, which features fast and accurate radio map estimation without the transmitters' information. The radio map is inferred by exploiting the interaction between distributed received signal strength (RSS) measurements at mobile users and the geographical map using a deep neural network estimator, resulting in low data-acquisition cost and computational complexity. Moreover, a GAN-based learning algorithm is proposed to boost the inference capability of the deep neural network estimator by exploiting the power of generative AI. Simulation results showcase that the proposed GAN-CRME is even capable of coarse error-correction when the geographical map information is inaccurate.


title: How phonemes contribute to deep speaker models?

abstract: Which phonemes convey more speaker traits is a long-standing question, and various perception experiments were conducted with human subjects. For speaker recognition, studies were conducted with the conventional statistical models and the drawn conclusions are more or less consistent with the perception results. However, which phonemes are more important with modern deep neural models is still unexplored, due to the opaqueness of the decision process. This paper conducts a novel study for the attribution of phonemes with two types of deep speaker models that are based on TDNN and CNN respectively, from the perspective of model explanation. Specifically, we conducted the study by two post-explanation methods: LayerCAM and Time Align Occlusion (TAO). Experimental results showed that: (1) At the population level, vowels are more important than consonants, confirming the human perception studies. However, fricatives are among the most unimportant phonemes, which contrasts with previous studies. (2) At the speaker level, a large between-speaker variation is observed regarding phoneme importance, indicating that whether a phoneme is important or not is largely speaker-dependent.


title: Computing Augustin Information via Hybrid Geodesically Convex Optimization

abstract: We propose a Riemannian gradient descent with the Poincar\'e metric to compute the order-$\alpha$ Augustin information, a widely used quantity for characterizing exponential error behaviors in information theory. We prove that the algorithm converges to the optimum at a rate of $\mathcal{O}(1 / T)$. As far as we know, this is the first algorithm with a non-asymptotic optimization error guarantee for all positive orders. Numerical experimental results demonstrate the empirical efficiency of the algorithm. Our result is based on a novel hybrid analysis of Riemannian gradient descent for functions that are geodesically convex in a Riemannian metric and geodesically smooth in another.


title: A Generative Approach to Surrogate-based Black-box Attacks

abstract: Surrogate-based black-box attacks have exposed the heightened vulnerability of DNNs. These attacks are designed to craft adversarial examples for any samples with black-box target feedback for only a given set of samples. State-of-the-art surrogate-based attacks involve training a discriminative surrogate that mimics the target's outputs. The goal is to learn the decision boundaries of the target. The surrogate is then attacked by white-box attacks to craft adversarial examples similar to the original samples but belong to other classes. With limited samples, the discriminative surrogate fails to accurately learn the target's decision boundaries, and these surrogate-based attacks suffer from low success rates. Different from the discriminative approach, we propose a generative surrogate that learns the distribution of samples residing on or close to the target's decision boundaries. The distribution learned by the generative surrogate can be used to craft adversarial examples that have imperceptible differences from the original samples but belong to other classes. The proposed generative approach results in attacks with remarkably high attack success rates on various targets and datasets.


title: ToonAging: Face Re-Aging upon Artistic Portrait Style Transfer

abstract: Face re-aging is a prominent field in computer vision and graphics, with significant applications in photorealistic domains such as movies, advertising, and live streaming. Recently, the need to apply face re-aging to non-photorealistic images, like comics, illustrations, and animations, has emerged as an extension in various entertainment sectors. However, the lack of a network that can seamlessly edit the apparent age in NPR images has limited these tasks to a naive, sequential approach. This often results in unpleasant artifacts and a loss of facial attributes due to domain discrepancies. In this paper, we introduce a novel one-stage method for face re-aging combined with portrait style transfer, executed in a single generative step. We leverage existing face re-aging and style transfer networks, both trained within the same PR domain. Our method uniquely fuses distinct latent vectors, each responsible for managing aging-related attributes and NPR appearance. By adopting an exemplar-based approach, our method offers greater flexibility compared to domain-level fine-tuning approaches, which typically require separate training or fine-tuning for each domain. This effectively addresses the limitation of requiring paired datasets for re-aging and domain-level, data-driven approaches for stylization. Our experiments show that our model can effortlessly generate re-aged images while simultaneously transferring the style of examples, maintaining both natural appearance and controllability.


title: InVA: Integrative Variational Autoencoder for Harmonization of Multi-modal Neuroimaging Data

abstract: There is a significant interest in exploring non-linear associations among multiple images derived from diverse imaging modalities. While there is a growing literature on image-on-image regression to delineate predictive inference of an image based on multiple images, existing approaches have limitations in efficiently borrowing information between multiple imaging modalities in the prediction of an image. Building on the literature of Variational Auto Encoders (VAEs), this article proposes a novel approach, referred to as Integrative Variational Autoencoder (\texttt{InVA}) method, which borrows information from multiple images obtained from different sources to draw predictive inference of an image. The proposed approach captures complex non-linear association between the outcome image and input images, while allowing rapid computation. Numerical results demonstrate substantial advantages of \texttt{InVA} over VAEs, which typically do not allow borrowing information between input images. The proposed framework offers highly accurate predictive inferences for costly positron emission topography (PET) from multiple measures of cortical structure in human brain scans readily available from magnetic resonance imaging (MRI).


title: Timed-Elastic-Band Based Variable Splitting for Autonomous Trajectory Planning

abstract: Existing trajectory planning methods are struggling to handle the issue of autonomous track swinging during navigation, resulting in significant errors when reaching the destination. In this article, we address autonomous trajectory planning problems, which aims at developing innovative solutions to enhance the adaptability and robustness of unmanned systems in navigating complex and dynamic environments. We first introduce the variable splitting (VS) method as a constrained optimization method to reimagine the renowned Timed-Elastic-Band (TEB) algorithm, resulting in a novel collision avoidance approach named Timed-Elastic-Band based variable splitting (TEB-VS). The proposed TEB-VS demonstrates superior navigation stability, while maintaining nearly identical resource consumption to TEB. We then analyze the convergence of the proposed TEB-VS method. To evaluate the effectiveness and efficiency of TEB-VS, extensive experiments have been conducted using TurtleBot2 in both simulated environments and real-world datasets.


title: Using Motion Cues to Supervise Single-Frame Body Pose and Shape Estimation in Low Data Regimes

abstract: When enough annotated training data is available, supervised deep-learning algorithms excel at estimating human body pose and shape using a single camera. The effects of too little such data being available can be mitigated by using other information sources, such as databases of body shapes, to learn priors. Unfortunately, such sources are not always available either. We show that, in such cases, easy-to-obtain unannotated videos can be used instead to provide the required supervisory signals. Given a trained model using too little annotated data, we compute poses in consecutive frames along with the optical flow between them. We then enforce consistency between the image optical flow and the one that can be inferred from the change in pose from one frame to the next. This provides enough additional supervision to effectively refine the network weights and to perform on par with methods trained using far more annotated data.


title: Comprehensive study of magnetic field evolution in relativistic jets based on 2D simulations

abstract: We use two-dimensional particle-in-cell simulations to investigate the generation and evolution of the magnetic field associated with the propagation of a jet for various initial conditions. We demonstrate that, in general, the magnetic field is initially grown by the Weibel and Mushroom instabilities. However, the field is saturated by the Alfv'en current limit. For initially non-magnetized plasma, we show that the growth of the magnetic field is delayed when the matter density of the jet environment is lower, which are in agreement with simple analytical predictions. We show that the higher Lorentz factor ($\gtrsim 2$) prevents rapid growth of the magnetic fields. When the initial field is troidal, the position of the magnetic filaments moves away from the jet as the field strength increases. The axial initial field helps the jet maintain its shape more effectively than the troidal initial field.


title: Improving Robustness of LiDAR-Camera Fusion Model against Weather Corruption from Fusion Strategy Perspective

abstract: In recent years, LiDAR-camera fusion models have markedly advanced 3D object detection tasks in autonomous driving. However, their robustness against common weather corruption such as fog, rain, snow, and sunlight in the intricate physical world remains underexplored. In this paper, we evaluate the robustness of fusion models from the perspective of fusion strategies on the corrupted dataset. Based on the evaluation, we further propose a concise yet practical fusion strategy to enhance the robustness of the fusion models, namely flexibly weighted fusing features from LiDAR and camera sources to adapt to varying weather scenarios. Experiments conducted on four types of fusion models, each with two distinct lightweight implementations, confirm the broad applicability and effectiveness of the approach.


title: DisDet: Exploring Detectability of Backdoor Attack on Diffusion Models

abstract: In the exciting generative AI era, the diffusion model has emerged as a very powerful and widely adopted content generation and editing tool for various data modalities, making the study of their potential security risks very necessary and critical. Very recently, some pioneering works have shown the vulnerability of the diffusion model against backdoor attacks, calling for in-depth analysis and investigation of the security challenges of this popular and fundamental AI technique. In this paper, for the first time, we systematically explore the detectability of the poisoned noise input for the backdoored diffusion models, an important performance metric yet little explored in the existing works. Starting from the perspective of a defender, we first analyze the properties of the trigger pattern in the existing diffusion backdoor attacks, discovering the important role of distribution discrepancy in Trojan detection. Based on this finding, we propose a low-cost trigger detection mechanism that can effectively identify the poisoned input noise. We then take a further step to study the same problem from the attack side, proposing a backdoor attack strategy that can learn the unnoticeable trigger to evade our proposed detection scheme. Empirical evaluations across various diffusion models and datasets demonstrate the effectiveness of the proposed trigger detection and detection-evading attack strategy. For trigger detection, our distribution discrepancy-based solution can achieve a 100\% detection rate for the Trojan triggers used in the existing works. For evading trigger detection, our proposed stealthy trigger design approach performs end-to-end learning to make the distribution of poisoned noise input approach that of benign noise, enabling nearly 100\% detection pass rate with very high attack and benign performance for the backdoored diffusion models.


title: Phase Space Distribution Functions and Energy Distributions of Dark Matter Particles in Haloes

abstract: For a spherical dark matter halo with isotropic velocity distribution, the phase space distribution function (DF), the energy distribution, and the density profile form a set of self-consistent description of its equilibrium state, and knowing one is sufficient to determine the other two. The Navarro-Frenk-White density profile (NFW profile) is known to be a good approximation to the spherically-averaged density distribution in simulated haloes. The DARKexp energy distribution is also known to compare well with the simulated energy distribution. We present a quantitative assessment of the NFW and DARKexp fits to the simulated DF and energy distribution for a wide range of haloes in a dark-matter-only simulation from the IllustrisTNG Project. As expected, we find that the NFW fits work well except at low energy when the density at small radii deviates from the NFW profile. Further, the NFW and DARKexp fits have comparable accuracy in the region where both fit well, but the DARKexp fits are better at low energy because they require matching of the central gravitational potential. We also find an approximate relation between the energy scale parameterizing the DARKexp energy distribution and that defined by the characteristic density and radius of the NFW profile. This relation may be linked to the relaxation process during halo formation.


title: Glocal Hypergradient Estimation with Koopman Operator

abstract: Gradient-based hyperparameter optimization methods update hyperparameters using hypergradients, gradients of a meta criterion with respect to hyperparameters. Previous research used two distinct update strategies: optimizing hyperparameters using global hypergradients obtained after completing model training or local hypergradients derived after every few model updates. While global hypergradients offer reliability, their computational cost is significant; conversely, local hypergradients provide speed but are often suboptimal. In this paper, we propose *glocal* hypergradient estimation, blending "global" quality with "local" efficiency. To this end, we use the Koopman operator theory to linearize the dynamics of hypergradients so that the global hypergradients can be efficiently approximated only by using a trajectory of local hypergradients. Consequently, we can optimize hyperparameters greedily using estimated global hypergradients, achieving both reliability and efficiency simultaneously. Through numerical experiments of hyperparameter optimization, including optimization of optimizers, we demonstrate the effectiveness of the glocal hypergradient estimation.


title: Bifurcation to complex dynamics in largely modulated voltage-controlled parametric oscillator

abstract: An experimental demonstration of a parametric oscillation of a magnetization in a ferromagnet was performed recently by applying a microwave voltage, indicating the potential to be applied in a switching method in non-volatile memories. In the previous works, the modulation of a perpendicular magnetic anisotropy field produced by the microwave voltage was small compared with an external magnetic field pointing in an in-plane direction. A recent trend is, however, opposite, where an efficiency of the voltage controlled magnetic anisotropy (VCMA) effect is increased significantly by material research and thus, the modulated magnetic anisotropy field can be larger than the external magnetic field. Here, we solved the Landau-Lifshitz-Gilbert equation numerically and investigated the magnetization dynamics driven under a wide range of the microwave VCMA effect. We evaluated bifurcation diagrams, which summarize local maxima of the magnetization dynamics. For low modulation amplitudes, the local maximum is a single point because the dynamics is the periodic parametric oscillation. The bifurcation diagrams show distributions of the local maxima when the microwave magnetic anisotropy field becomes larger than the external magnetic field. The appearance of this broadened distribution indicates complex dynamics such as chaotic and transient-chaotic behaviors, which were confirmed from an analysis of temporal dynamics.


title: A Grammar of Dumont and a Theorem of Diaconis-Evans-Graham

abstract: We came across an unexpected connection between a remarkable grammar of Dumont for the joint distribution of $(\exc, \fix)$ over $S_n$ and a beautiful theorem of Diaconis-Evans-Graham on successions and fixed points of permutations. With the grammar in hand, we demonstrate the advantage of the grammatical calculus in deriving the generating functions, where the constant property plays a substantial role. On the grounds of left successions of a permutation, we present a grammatical treatment of the joint distribution investigated by Roselle. Moreover, we obtain a left succession analogue of the Diaconis-Evans-Graham theorem, exemplifying the idea of a grammar assisted bijection. The grammatical labelings give rise to an equidistribution of $(\jump, \des)$ and $(\exc, \drop)$ restricted to the set of left successions and the set of fixed points, where $\jump$ is defined to be the number of ascents minus the number of left successions.


title: Supersymmetry dictated topology in periodic gauge fields and realization in strained and twisted 2D materials

abstract: Supersymmetry (SUSY) of Hamiltonian dictates double degeneracy between a pair of superpartners (SPs) transformed by supercharge, except at zero energy where modes remain unpaired in many cases. Here we explore a SUSY of complete isospectrum between SPs -- with paired zero modes -- realized by 2D electrons in zero-flux periodic gauge fields, which can describe twisted or periodically strained 2D materials. We find their low-energy sector containing zero (or threshold) modes must be topologically non-trivial, by proving that Chern numbers of the two SPs have a finite difference dictated by the number of zero modes and energy dispersion in their vicinity. In $30^\circ$ twisted bilayer (double bilayer) transition metal dichalcogenides subject to periodic strain, we find one SP is topologically trivial in its lowest miniband, while the twin SP of identical dispersion has a Chern number of $1$ ($2$), in stark contrast to time-reversal partners that have to be simultaneously trivial or nontrivial. For systems whose physical Hamiltonian corresponds to the square root of a SUSY Hamiltonian, such as twisted or strained bilayer graphene, we reveal that topological properties of the two SUSY SPs are transferred respectively to the conduction and valence bands, including the contrasted topology in the low-energy sector and identical topology in the high-energy sector. This offers a unified perspective for understanding topological properties in many flat-band systems described by such square-root models. Both types of SUSY systems provide unique opportunities for exploring correlated and topological phases of matter.


title: Optimal dynamic climate adaptation pathways: a case study of New York City

abstract: Assessing climate risk and its potential impacts on our cities and economies is of fundamental importance. Extreme weather events, such as hurricanes, floods, and storm surges can lead to catastrophic damages. We propose a flexible approach based on real options analysis and extreme value theory, which enables the selection of optimal adaptation pathways for a portfolio of climate adaptation projects. We model the severity of extreme sea level events using the block maxima approach from extreme value theory, and then develop a real options framework, factoring in climate change, sea level rise uncertainty, and the growth in asset exposure. We then apply the proposed framework to a real-world problem, considering sea level data as well as different adaptation investment options for New York City. Our research can assist governments and policy makers in taking informed decisions about optimal adaptation pathways and more specifically about reducing flood and storm surge risk in a dynamic settings.


title: Standard Gaussian Process Can Be Excellent for High-Dimensional Bayesian Optimization

abstract: There has been a long-standing and widespread belief that Bayesian Optimization (BO) with standard Gaussian process (GP), referred to as standard BO, is ineffective in high-dimensional optimization problems. While this belief sounds reasonable, strong empirical evidence is lacking. In this paper, we systematically investigated BO with standard GP regression across a variety of synthetic and real-world benchmark problems for high-dimensional optimization. We found that, surprisingly, when using Mat\'ern kernels and Upper Confidence Bound (UCB), standard BO consistently achieves top-tier performance, often outperforming other BO methods specifically designed for high-dimensional optimization. Contrary to the stereotype, we found that standard GP equipped with Mat\'ern kernels can serve as a capable surrogate for learning high-dimensional functions. Without strong structural assumptions, BO with standard GP not only excels in high-dimensional optimization but also is robust in accommodating various structures within target functions. Furthermore, with standard GP, achieving promising optimization performance is possible via maximum a posterior (MAP) estimation with diffuse priors or merely maximum likelihood estimation, eliminating the need for expensive Markov-Chain Monte Carlo (MCMC) sampling that might be required by more complex surrogate models. In parallel, we also investigated and analyzed alternative popular settings in running standard BO, which, however, often fail in high-dimensional optimization. This might link to the a few failure cases reported in literature. We thus advocate for a re-evaluation and in-depth study of the potential of standard BO in addressing high-dimensional problems.


title: Emergence of a condensate with finite-energy Cooper pairing in hybrid exciton/superconductor systems

abstract: We study theoretically a setup consisting of excitons formed in two valleys, with proximity-induced Cooper pairing, different in conduction and valence bands. Due to the combination of Coulomb interaction with superconducting proximity effects, Cooper pairing between electrons from conduction and valence bands from different valleys is formed. This finite-energy intervalley Cooper pairing has both even- and odd-frequency contributions. We show that there is a phase transition into formation of a robust macroscopic condensate of such Cooper pairs and present characteristics of the corresponding Higgs modes.


title: Horizontality with infinite complexity in the twistor spaces on tori

abstract: We study the complexity of horizontality in the twistor space $\hat{E}$ associated with an oriented vector bundle $E$ of rank $4$ with a positive-definite metric over a torus. If the horizontality has finite complexity of degree $d>2$ for an element of a fiber of $\hat{E}$, then the complexity is expressed in terms of a finite subgroup of $SO(3)$ ([1]). In the present paper, it is seen that if the horizontality has infinite complexity derived from one of the cases studied in [1], then the complexity is expressed by a dense subset of $S^2$.


title: Loomis-Whitney inequalities on corank $1$ Carnot groups

abstract: In this paper we provide another way to deduce the Loomis-Whitney inequality on higher dimensional Heisenberg groups $\mathbb{H}^n$ based on the one on the first Heisenberg group $\mathbb{H}^1$ and the known nonlinear Loomis-Whitney inequality (which has more projections than ours). Moreover, we generalize the result to the case of corank $1$ Carnot groups and products of such groups. Our main tool is the modified equivalence between the Brascamp--Lieb inequality and the subadditivity of the entropy developed in arXiv:0710.0870v2.


title: KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

abstract: Efficiently serving large language models (LLMs) requires batching many requests together to reduce the cost per request. Yet, the key-value (KV) cache, which stores attention keys and values to avoid re-computations, significantly increases memory demands and becomes the new bottleneck in speed and memory usage. This memory demand increases with larger batch sizes and longer context lengths. Additionally, the inference speed is limited by the size of KV cache, as the GPU's SRAM must load the entire KV cache from the main GPU memory for each token generated, causing the computational core to be idle during this process. A straightforward and effective solution to reduce KV cache size is quantization, which decreases the total bytes taken by KV cache. However, there is a lack of in-depth studies that explore the element distribution of KV cache to understand the hardness and limitation of KV cache quantization. To fill the gap, we conducted a comprehensive study on the element distribution in KV cache of popular LLMs. Our findings indicate that the key cache should be quantized per-channel, i.e., group elements along the channel dimension and quantize them together. In contrast, the value cache should be quantized per-token. From this analysis, we developed a tuning-free 2bit KV cache quantization algorithm, named KIVI. With the hardware-friendly implementation, KIVI can enable Llama (Llama-2), Falcon, and Mistral models to maintain almost the same quality while using $\mathbf{2.6\times}$ less peak memory usage (including the model weight). This reduction in memory usage enables up to $\mathbf{4\times}$ larger batch size, bringing $\mathbf{2.35\times \sim 3.47\times}$ throughput on real LLM inference workload. The source code is available at https://github.com/jy-yuan/KIVI.


title: Tantalum electrodeposition on glass-ceramic substrate -- compositional and structural analyses

abstract: Electrodeposition of tantalum thin coating was attempted from a room temperature ionic liquid, BMP[Tf2N] in presence of dissolved TaF5 and LiF. The influence of deposition parameters, such as ionic liquid composition, substrate type, electrical potential or temperature upon structure and composition was observed. Cyclic voltammetry, scanning transmission electron microscopy (STEM) in conjunction with energy dispersive X-ray analysis (EDX), X-ray photoelectron spectroscopy (XPS), as well as X-ray diffraction (XRD) techniques were applied. The reversibility of the reduction processes was examined, and comparison made to deposition from molten salt systems.


title: Fast single pixel modal wavefront sensing using neural networks

abstract: Dynamic wavefront aberrations negatively impact a wide range of optical applications including astronomy, optical free-space telecommunications and bio-imaging. Wavefront errors can be compensated by an adaptive optics system comprised of a deformable mirror and wavefront sensor connected by a control loop. For satellite optical communications (SatCom), wavefront sensing is particularly challenging due to the rapid wavefront fluctuations induced by strong turbulence and movement of the transmitting satellite across the sky. Existing wavefront sensing techniques require fast cameras (>kHz) that are not widely available at wavelengths suitable for SatCom (e.g., 1550nm and mid-to-long wave infrared). Here, we propose a new wavefront sensing technique that uses a single photodiode and a fast mirror to make phase-diverse intensity measurements of the incoming wavefront. We train neural networks to accurately estimate the input phase given this phase-diverse sub-millisecond intensity trace. Our simulations show that our technique is robust in cases of strong turbulence where previous modal wavefront sensors fail due to modal crosstalk, achieving 99% of the optimal Strehl ratio from a 50-mode correction at a sensing rate of 2kHz. We explore typical cases of turbulence magnitude, sensing speed and noise that might be encountered by such a system.