title: The Chow Ring Classes of $\mathrm{PGL}_3$ Orbit Closures in $\mathbb{G}(1, 5)$

abstract: The space of all pencils of conics in the plane $\mathbb{P} V$ (where $\dim V = 3$) is a projective Grassmannian $\mathbb{G} (1, \mathbb{P} \mathrm{Sym}^2 V^*)$ and admits a natural $\mathrm{PGL}(V)$ action. It is a classical theorem that this action has exactly eight orbits, and in fact that the orbit of a pencil $\ell \subset \mathbb{P} \mathrm{Sym}^2 V^*$ is determined completely by its position with respect to the Veronese surface $X \subset \mathbb{P} \mathrm{Sym}^2V^*$ of rank 1 conics and its secant variety $S(X) \subset \mathbb{P} \mathrm{Sym}^2 V^*$, which is the cubic fourfold of rank 2 conics. In this paper, we present some geometric descriptions of these orbits. Then, using a mixture of direct enumerative techniques and some Chern class computations, we present a calculation of the classes of the orbit closures in the Chow ring of this Grassmannian (and consequently also of their degrees under the Pl\"ucker embedding $\mathbb{G} (1, \mathbb{P} \mathrm{Sym}^2 V^*)\hookrightarrow \mathbb{P} \Lambda^2 \mathrm{Sym}^2 V^*$).


title: Where to serve and return in Badminton Men's Double?

abstract: This study aims to analyze the service and return landing areas in badminton men's double, based on data extracted from 20 badminton matches. We find that most services land near the center-line, while returns tend to land in the crossing areas of the serving team's court. Using generalized logit models, we are able to predict the return landing area based on features of the service and return round. We find that the direction of the service and the footwork and grip of the receiver could indicate his intended return landing area. Additionally, we discover that servers tend to intercept in specific areas based on their serving position. Our results offer valuable insights into the strategic decisions made by players in the service and return of a badminton rally.


title: Improving Channel Estimation Performance for Uplink OTFS Transmissions: Pilot Design based on A Posteriori Cramer-Rao Bound

abstract: Orthogonal time frequency space (OTFS) has been widely acknowledged as a promising wireless technology for challenging transmission scenarios, including high-mobility channels. In this paper, we investigate the pilot design for the multi-user OTFS system based on the a priori statistical channel state information (CSI), where the practical threshold-based estimation scheme is adopted. Specifically, we first derive the a posteriori Cramer-Rao bound (PCRB) based on a priori channel information for each user. According to our derivation, the PCRB only relates to the user's pilot signal-to-noise ratio (SNR) and the range of delay and Doppler shifts under the practical power-delay and power-Doppler profiles. Then, a pilot scheme is proposed to minimize the average PCRB of different users, where a closed-form global optimal pilot power allocation is derived. Our numerical results verify the multi-user PCRB analysis. Also, we demonstrate an around 3 dB improvement in the average normalized-mean-square error (NMSE) by using the proposed pilot design in comparison to the conventional embedded pilot design under the same total pilot power.


title: Breaking the Trilemma of Privacy, Utility, Efficiency via Controllable Machine Unlearning

abstract: Machine Unlearning (MU) algorithms have become increasingly critical due to the imperative adherence to data privacy regulations. The primary objective of MU is to erase the influence of specific data samples on a given model without the need to retrain it from scratch. Accordingly, existing methods focus on maximizing user privacy protection. However, there are different degrees of privacy regulations for each real-world web-based application. Exploring the full spectrum of trade-offs between privacy, model utility, and runtime efficiency is critical for practical unlearning scenarios. Furthermore, designing the MU algorithm with simple control of the aforementioned trade-off is desirable but challenging due to the inherent complex interaction. To address the challenges, we present Controllable Machine Unlearning (ConMU), a novel framework designed to facilitate the calibration of MU. The ConMU framework contains three integral modules: an important data selection module that reconciles the runtime efficiency and model generalization, a progressive Gaussian mechanism module that balances privacy and model generalization, and an unlearning proxy that controls the trade-offs between privacy and runtime efficiency. Comprehensive experiments on various benchmark datasets have demonstrated the robust adaptability of our control mechanism and its superiority over established unlearning methods. ConMU explores the full spectrum of the Privacy-Utility-Efficiency trade-off and allows practitioners to account for different real-world regulations. Source code available at: https://github.com/guangyaodou/ConMU.


title: The Milky Way Bulge extra-tidal star survey: BH 261 (AL 3)

abstract: The Milky Way Bulge extra-tidal star survey (MWBest) is a spectroscopic survey with the goal of identifying stripped globular cluster stars from inner Galaxy clusters. In this way, an indication of the fraction of metal-poor bulge stars that originated from globular clusters can be determined. We observed and analyzed stars in and around BH 261, an understudied globular cluster in the bulge. From seven giants within the tidal radius of the cluster, we measured an average heliocentric radial velocity of <RV> = -61 +- 2.6 km/s with a radial velocity dispersion of \sigma = 6.1 +- 1.9 km/s. The large velocity dispersion may have arisen from tidal heating in the cluster's orbit about the Galactic center, or because BH 261 has a high dynamical mass as well as a high mass-to-light ratio. From spectra of five giants, we measure an average metallicity of <[Fe/H]> = -1.1 +- 0.2 dex. We also spectroscopically confirm an RR Lyrae star in BH 261, which yields a distance to the cluster of 7.1 +- 0.4~kpc. Stars with 3D velocities and metallicities consistent with BH 261 reaching to ~0.5 degrees from the cluster are identified. A handful of these stars are also consistent with the spatial distribution of that potential debris from models focussing on the most recent disruption of the cluster.


title: Renormalization Group Approach for Modified vdP Oscillator with $\mathcal{PT}$ Symmetric Non-Hermitian Interaction

abstract: We consider a modified version of the well-known 2d vdP oscillator with a new non-Hermitian interaction. The usual perturbative approach fails to provide the classical dynamics of the system as the classical solutions become divergent in the long time limit. These kinds of divergences are similar to what occurs in quantum field theory and critical phenomena. The Renormalization Group (RG) technique for the dynamical system has been used to eliminate the divergences in the perturbative solution of the 2d vdP oscillator and to provide a physically acceptable solution which is shown to be consistent with numerical study. We further investigate the model in the framework of non-Hermitian quantum mechanics to show the $\mathcal{PT}$ phase transition in the system.


title: QoS Aware Transmit Beamforming for Secure Backscattering in Symbiotic Radio Systems

abstract: This paper focuses on secure backscatter transmission in the presence of a passive multi-antenna eavesdropper through a symbiotic radio (SR) network. Specifically, a single-antenna backscatter device (BD) aims to transmit confidential information to a primary receiver (PR) by using a multi-antenna primary transmitter's (PT) signal, where the received symbols are jointly decoded at the PR. Our objective is to achieve confidential communications for BD while ensuring that the primary system's quality of service (QoS) requirements are met. We propose an alternating optimisation algorithm that maximises the achievable secrecy rate of BD by jointly optimising primary transmit beamforming and power sharing between information and artificial noise (AN) signals. Numerical results verify our analytical claims on the optimality of the proposed solution and the proposed methodology's underlying low complexity. Additionally, our simulations provide nontrivial design insights into the critical system parameters and quantify the achievable gains over the relevant benchmark schemes.


title: Simulations of the Visible, Infrared and Terahertz Properties of Doped Cyclo[18]carbon Molecules Using Tuned Exchange-Correlation Potential

abstract: Cyclocarbon molecules are critical in understanding the carbon structure formation and the nature of the interaction between carbon atoms. In cyclocarbons, light elements such as H, O and N may interplay with rings to form doped cyclocarbon molecules. Such molecules show unique optical properties that have never been reported before. In this study, density functional theory with a tuned PBE functional (39% HF exchange) is employed to study the ground and excited states of a cyclo[18] carbon molecule (C18) and its doped variants C18M (M = H, Be, B, N, and O). The doping is shown to either make the UV-Vis spectra of C18 blue- or red-shifted depending on the spin brought by the dopant. Furthermore, introducing extra-atoms is found to cause the emergence of a new set of infrared modes in the structure under investigation. Finally, applying the molecular dynamic simulations enables one to observe the terahertz characteristics of C18M with frequencies up to 1.5 THz due to the propagation of a particular pattern along the carbon ring.


title: Functional Group Induced Transformations in Stacking and Electron Structure in Mo2CTx/NiS Heterostructures

abstract: The two-dimensional transition metal carbide/nitride family (MXenes) has garnered significant attention due to their highly customizable surface functional groups. Leveraging modern material science techniques, the customizability of MXenes can be enhanced further through the construction of associated heterostructures. As indicated by recent research, the Mo2CTx/NiS heterostructure has emerged as a promising candidate exhibiting superior physical and chemical application potential. The geometrical structure of Mo2CTx/NiS heterostructure is modeled and 6 possible configurations are validated by Density Functional Theory simulations. The variation in functional groups leads to structural changes in Mo2CTx/NiS interfaces, primarily attributed to the competition between van der Waals and covalent interactions. The presence of different functional groups results in significant band fluctuations near the Fermi level for Ni and Mo atoms, influencing the role of atoms and electron's ability to escape near the interface. This, in turn, modulates the strength of covalent interactions at the MXenes/NiS interface and alters the ease of dissociation of the MXenes/NiS complex. Notably, the Mo2CO2/NiS(P6_3/mmc) heterostructure exhibits polymorphism, signifying that two atomic arrangements can stabilize the structure. The transition process between these polymorphs is also simulated, further indicating the modulation of the electronic level of properties by a sliding operation.


title: Shift of nuclear clock transition frequency in $^{229}$Th ions due to hyperfine interaction

abstract: We calculate hyperfine structure of $^{229}$Th and its ions (Th~IV, Th~III, Th~II, Th~I) to reveal the dependence of the nuclear clock frequency on the hyperfine interaction (hfi). We calculate first and second-order hfi shifts and demonstrate that due to the differences in the hyperfine structure for different ions and for the ground and isomeric nuclear states, the nuclear frequencies in Th~IV, Th~III, Th~II and Th~I are also different. The first-order shift of frequency is large for a particular hyperfine component, but it vanishes after averaging over all hyperfine states. The second-order shift is small but it does not vanish after averaging. It is three to six orders of magnitude smaller than the shift of the nuclear frequencies due to the Coulomb electron-nucleus interaction considered in our previous work (V. A. Dzuba and V. V. Flambaum, arXiv:2309.11176 (2023)). However, it is six to eight orders of magnitude larger than the projected accuracy of the nuclear clock ($10^{-19}$).


title: Accelerating LLaMA Inference by Enabling Intermediate Layer Decoding via Instruction Tuning with LITE

abstract: Large Language Models (LLMs) have achieved remarkable performance across a wide variety of natural language tasks; however, their large size makes their inference slow and computationally expensive. Focusing on this problem, we propose to instruction tune LLMs with additional explicit losses from the intermediate layers (LITE) and show that it enables these layers to acquire 'good' generation ability without affecting the generation ability of the final layer. We perform 'dynamic confidence-based early exiting' at token level from the intermediate layers which improves the efficiency of text generation without compromising the quality of the generation. We conduct comprehensive experiments by instruction tuning LLaMA-2 models on the Alpaca dataset and holistically evaluate on four different human-instruction test sets. We show that dynamic early exiting achieves consistent and considerable inference computation cost improvements (37.86% for 7B and 46.35% for 13B model) while maintaining the generation quality of the responses. We further conduct a thorough analysis of the results over several important aspects, such as comparing the semantic similarity of the outputs and dissecting the efficiency improvements by comparing the number of tokens generated in the output. In summary, our work contributes to improving the efficiency of LLM inference while maintaining the generation quality, a crucial step en route to enabling their widespread adoption.


title: Data-driven learning of the generalized Langevin equation with state-dependent memory

abstract: We present a data-driven method to learn stochastic reduced models of complex systems that retain a state-dependent memory beyond the standard generalized Langevin equation (GLE) with a homogeneous kernel. The constructed model naturally encodes the heterogeneous energy dissipation by jointly learning a set of state features and the non-Markovian coupling among the features. Numerical results demonstrate the limitation of the standard GLE and the essential role of the broadly overlooked state-dependency nature in predicting molecule kinetics related to conformation relaxation and transition.


title: Self-Supervised Multi-Modality Learning for Multi-Label Skin Lesion Classification

abstract: The clinical diagnosis of skin lesion involves the analysis of dermoscopic and clinical modalities. Dermoscopic images provide a detailed view of the surface structures whereas clinical images offer a complementary macroscopic information. The visual diagnosis of melanoma is also based on seven-point checklist which involves identifying different visual attributes. Recently, supervised learning approaches such as convolutional neural networks (CNNs) have shown great performances using both dermoscopic and clinical modalities (Multi-modality). The seven different visual attributes in the checklist are also used to further improve the the diagnosis. The performances of these approaches, however, are still reliant on the availability of large-scaled labeled data. The acquisition of annotated dataset is an expensive and time-consuming task, more so with annotating multi-attributes. To overcome this limitation, we propose a self-supervised learning (SSL) algorithm for multi-modality skin lesion classification. Our algorithm enables the multi-modality learning by maximizing the similarities between paired dermoscopic and clinical images from different views. In addition, we generate surrogate pseudo-multi-labels that represent seven attributes via clustering analysis. We also propose a label-relation-aware module to refine each pseudo-label embedding and capture the interrelationships between pseudo-multi-labels. We validated the effectiveness of our algorithm using well-benchmarked seven-point skin lesion dataset. Our results show that our algorithm achieved better performances than other state-of-the-art SSL counterparts.


title: Investigating scaling relations in X-ray reverberating AGN using symbolic regression

abstract: Symbolic regression (SR) is a regression analysis based on genetic algorithms to search for mathematical expressions that best fit a given data set, by allowing the expressions themselves to mutate. We use the SR to analyze the parameter relations of the X-ray reverberating Active Galactic Nuclei (AGN) where the soft Fe-L lags were observed by XMM-Newton. Firstly, we revisit the lag-mass scaling relations by using the SR to derive all possible mathematical expressions and test them in terms of accuracy, simplicity and robustness. We find that the correlation between the lags, $\tau$, and the black hole mass, $M_{\rm BH}$, is certain, but the relation should be written in the form of $\log ({\tau}) = \alpha + \beta (\log{(M_{\rm BH}/M_{\odot})})^{\gamma}$, where $1 \lesssim \gamma \lesssim 2$. Moreover, incorporating more parameters such as the reflection fraction ($RF$) and the Eddington ratio ($\lambda_{\rm Edd}$) to the lag-mass scaling relation is made possible by the SR. It reveals that $\alpha$, rather than being a constant, can be $-2.15 + 0.02RF$ or $0.03(RF + \lambda_{\rm Edd})$, with the fine-tuned different $\beta$ and $\gamma$. These further support the relativistic disc-reflection framework in which such functional dependencies can be straightforwardly explained. Furthermore, we derive their host-galaxy mass, $M_{\ast}$, by fitting the spectral energy distribution (SED). We find that the SR model supports a non-linear $M_{\rm BH}$--$M_{\ast}$ relationship, while $\log (M_{\rm BH}/M_{\ast})$ varies between $-5.4$ and $-1.5$, with an average value of $\sim -3.7$. No significant correlation between $M_{\ast}$ and $\lambda_{\rm Edd}$ is confirmed in these samples.


title: Visual Explanations via Iterated Integrated Attributions

abstract: We introduce Iterated Integrated Attributions (IIA) - a generic method for explaining the predictions of vision models. IIA employs iterative integration across the input image, the internal representations generated by the model, and their gradients, yielding precise and focused explanation maps. We demonstrate the effectiveness of IIA through comprehensive evaluations across various tasks, datasets, and network architectures. Our results showcase that IIA produces accurate explanation maps, outperforming other state-of-the-art explanation techniques.


title: Optimal Transport for Kernel Gaussian Mixture Models

abstract: The Wasserstein distance from optimal mass transport (OMT) is a powerful mathematical tool with numerous applications that provides a natural measure of the distance between two probability distributions. Several methods to incorporate OMT into widely used probabilistic models, such as Gaussian or Gaussian mixture, have been developed to enhance the capability of modeling complex multimodal densities of real datasets. However, very few studies have explored the OMT problems in a reproducing kernel Hilbert space (RKHS), wherein the kernel trick is utilized to avoid the need to explicitly map input data into a high-dimensional feature space. In the current study, we propose a Wasserstein-type metric to compute the distance between two Gaussian mixtures in a RKHS via the kernel trick, i.e., kernel Gaussian mixture models.


title: Assessing and Improving Syntactic Adversarial Robustness of Pre-trained Models for Code Translation

abstract: Context: Pre-trained models (PTMs) have demonstrated significant potential in automatic code translation. However, the vulnerability of these models in translation tasks, particularly in terms of syntax, has not been extensively investigated. Objective: To fill this gap, our study aims to propose a novel approach CoTR to assess and improve the syntactic adversarial robustness of PTMs in code translation. Method: CoTR consists of two components: CoTR-A and CoTR-D. CoTR-A generates adversarial examples by transforming programs, while CoTR-D proposes a semantic distance-based sampling data augmentation method and adversarial training method to improve the model's robustness and generalization capabilities. The Pass@1 metric is used by CoTR to assess the performance of PTMs, which is more suitable for code translation tasks and offers a more precise evaluation in real world scenarios. Results: The effectiveness of CoTR is evaluated through experiments on real world Java to Python datasets. The results demonstrate that CoTR-A can significantly reduce the performance of existing PTMs, while CoTR-D effectively improves the robustness of PTMs. Conclusion: Our study identifies the limitations of current PTMs, including large language models, in code translation tasks. It highlights the potential of CoTR as an effective solution to enhance the robustness of PTMs for code translation tasks.


title: Defining equations of $7$-dimensional model CR hypersurfaces

abstract: We obtain a complete normal form for models of real analytic uniformly $2$-nondegenerate CR hypersurfaces in $\mathbb{C}^4$, and present a detailed study of their local invariants. The normal form illustrates that $2$-nondegenerate models in $\mathbb{C}^4$ comprise a moduli space parameterized by two univariate holomorphic functions, which is in sharp contrast to the well known Levi-nondegenerate setting and the more recently discovered behavior of $2$-nondegenerate structures in $\mathbb{C}^3$. In further contrast to these previously studied settings, we demonstrate that not all $2$-nondegenerate structures in $\mathbb{C}^4$ arise as perturbations of homogeneous models. We derive defining equations for the homogeneous models, a set of $9$ structures, and find explicit formulas for their infinitesimal symmetries.


title: This Looks Like Those: Illuminating Prototypical Concepts Using Multiple Visualizations

abstract: We present ProtoConcepts, a method for interpretable image classification combining deep learning and case-based reasoning using prototypical parts. Existing work in prototype-based image classification uses a ``this looks like that'' reasoning process, which dissects a test image by finding prototypical parts and combining evidence from these prototypes to make a final classification. However, all of the existing prototypical part-based image classifiers provide only one-to-one comparisons, where a single training image patch serves as a prototype to compare with a part of our test image. With these single-image comparisons, it can often be difficult to identify the underlying concept being compared (e.g., ``is it comparing the color or the shape?''). Our proposed method modifies the architecture of prototype-based networks to instead learn prototypical concepts which are visualized using multiple image patches. Having multiple visualizations of the same prototype allows us to more easily identify the concept captured by that prototype (e.g., ``the test image and the related training patches are all the same shade of blue''), and allows our model to create richer, more interpretable visual explanations. Our experiments show that our ``this looks like those'' reasoning process can be applied as a modification to a wide range of existing prototypical image classification networks while achieving comparable accuracy on benchmark datasets.


title: Using Early Readouts to Mediate Featural Bias in Distillation

abstract: Deep networks tend to learn spurious feature-label correlations in real-world supervised learning tasks. This vulnerability is aggravated in distillation, where a student model may have lesser representational capacity than the corresponding teacher model. Often, knowledge of specific spurious correlations is used to reweight instances & rebalance the learning process. We propose a novel early readout mechanism whereby we attempt to predict the label using representations from earlier network layers. We show that these early readouts automatically identify problem instances or groups in the form of confident, incorrect predictions. Leveraging these signals to modulate the distillation loss on an instance level allows us to substantially improve not only group fairness measures across benchmark datasets, but also overall accuracy of the student model. We also provide secondary analyses that bring insight into the role of feature learning in supervision and distillation.


title: Inverse Decision Modeling: Learning Interpretable Representations of Behavior

abstract: Decision analysis deals with modeling and enhancing decision processes. A principal challenge in improving behavior is in obtaining a transparent description of existing behavior in the first place. In this paper, we develop an expressive, unifying perspective on inverse decision modeling: a framework for learning parameterized representations of sequential decision behavior. First, we formalize the forward problem (as a normative standard), subsuming common classes of control behavior. Second, we use this to formalize the inverse problem (as a descriptive model), generalizing existing work on imitation/reward learning -- while opening up a much broader class of research problems in behavior representation. Finally, we instantiate this approach with an example (inverse bounded rational control), illustrating how this structure enables learning (interpretable) representations of (bounded) rationality -- while naturally capturing intuitive notions of suboptimal actions, biased beliefs, and imperfect knowledge of environments.


title: Measurements of Extended Magnetic Fields in Laser-Solid Interaction

abstract: Magnetic fields generated from a laser-foil interaction are measured with high fidelity using a proton radiography scheme with in situ x-ray fiducials. In contrast to prior findings under similar experimental conditions, this technique reveals the self-generated, Biermann-battery fields extend beyond the edge of the expanding plasma plume to a radius of over 3.5 mm by t=+1.4 ns, a result not captured in state-of-the-art magneto-hydrodynamics simulations. An analysis of two mono-energetic proton populations confirms that proton deflection is dominated by magnetic fields far from the interaction (>2 mm) and electric fields are insignificant. Comparisons to prior work suggest a new physics mechanism for the magnetic field generation and transport in laser-solid interactions.


title: Fair Streaming Principal Component Analysis: Statistical and Algorithmic Viewpoint

abstract: Fair Principal Component Analysis (PCA) is a problem setting where we aim to perform PCA while making the resulting representation fair in that the projected distributions, conditional on the sensitive attributes, match one another. However, existing approaches to fair PCA have two main problems: theoretically, there has been no statistical foundation of fair PCA in terms of learnability; practically, limited memory prevents us from using existing approaches, as they explicitly rely on full access to the entire data. On the theoretical side, we rigorously formulate fair PCA using a new notion called \emph{probably approximately fair and optimal} (PAFO) learnability. On the practical side, motivated by recent advances in streaming algorithms for addressing memory limitation, we propose a new setting called \emph{fair streaming PCA} along with a memory-efficient algorithm, fair noisy power method (FNPM). We then provide its {\it statistical} guarantee in terms of PAFO-learnability, which is the first of its kind in fair PCA literature. Lastly, we verify the efficacy and memory efficiency of our algorithm on real-world datasets.


title: Quasinormal modes, temperatures and greybody factors of black holes in a generalized Rastall gravity theory

abstract: We introduce a modification in the energy-momentum conservation violating Rastall's theory of gravity and obtain a Reissner-Nordstr\"om-type black hole solution in spacetime surrounded by a cloud of strings and charge fields. We examine the horizons of the black hole along with the influence of the parameters of the model on it. The scalar quasinormal modes (QNMs) of oscillations of the black hole are also computed using the 6th order WKB approximation method. It is seen that the Rastall parameter $\beta$ and the newly introduced energy-momentum tensor trace parameter $\alpha$ as well as the charge parameter $q$ and strings field parameter $a$ influence the amplitude and damping of the QNMs. From the metric function, we obtain the temperature of the black hole and study the effects of the four model parameters $\beta$, $\alpha$, $q$ and $a$ on the temperature. We then examine the greybody factors associated with the black hole and the corresponding total absorption cross-section for it. It is seen that the modification we introduced in the Rastall theory has a drastic effect on various properties of the black hole and may lead to interesting outcomes in future when the better detection techniques will be available with the LISA and the Einstein Telescope.


title: Making the cut: end effects and the benefits of slicing

abstract: Cutting mechanics in soft solids have been a subject of study for several decades, an interest fuelled by the multitude of its applications, including material testing, manufacturing, and biomedical technology. Wire cutting is the simplest model system to analyze the cutting resistance of a soft material. However, even for this simple system, the complex failure mechanisms that underpin cutting are still not completely understood. Several models that connect the critical cutting force to the radius of the wire and the key mechanical properties of the cut material have been proposed. An almost ubiquitous simplifying assumption is a state of plane (and anti-plane) strain in the material. In this paper, we show that this assumption can lead to erroneous conclusions because even such a simple cutting problem is essentially three-dimensional. A planar approximation restricts the analysis to the stress distribution in the mid-plane. However, through finite element modeling, we reveal that the maximal tensile stress - and thus the likely location of cut initiation - is in fact located in the front plane. Friction reduces the magnitude of this stress, but this detrimental effect can be counteracted by large slice-to-push (shear-to-indentation) ratios. The introduction of these end effects helps reconcile a recent controversy around the role of friction in wire cutting, for it implies that slicing can indeed reduce required cutting forces, but only if the slice-push ratio and the friction coefficient are sufficiently large. Material strain-stiffening reduces the critical indentation depth required to initiate the cut further and thus needs to be considered when cutting non-linearly elastic materials.


title: How Hard is Takeover in DPoS Blockchains? Understanding the Security of Coin-based Voting Governance

abstract: Delegated-Proof-of-Stake (DPoS) blockchains, such as EOSIO, Steem and TRON, are governed by a committee of block producers elected via a coin-based voting system. We recently witnessed the first de facto blockchain takeover that happened between Steem and TRON. Within one hour of this incident, TRON founder took over the entire Steem committee, forcing the original Steem community to leave the blockchain that they maintained for years. This is a historical event in the evolution of blockchains and Web 3.0. Despite its significant disruptive impact, little is known about how vulnerable DPoS blockchains are in general to takeovers and the ways in which we can improve their resistance to takeovers. In this paper, we demonstrate that the resistance of a DPoS blockchain to takeovers is governed by both the theoretical design and the actual use of its underlying coin-based voting governance system. When voters actively cooperate to resist potential takeovers, our theoretical analysis reveals that the current active resistance of DPoS blockchains is far below the theoretical upper bound. However in practice, voter preferences could be significantly different. This paper presents the first large-scale empirical study of the passive takeover resistance of EOSIO, Steem and TRON. Our study identifies the diversity in voter preferences and characterizes the impact of this diversity on takeover resistance. Through both theoretical and empirical analyses, our study provides novel insights into the security of coin-based voting governance and suggests potential ways to improve the takeover resistance of any blockchain that implements this governance model.


title: Polar-ring galaxies in the Illustris TNG50 simulation

abstract: Polar-ring galaxies (PRGs) are an outstanding example of galaxies with misaligned kinematics where a typically red central galaxy is surrounded by a large-scale ring or disk of stars, gas and dust oriented almost perpendicular to the main body. It is believed that polar structures are formed in a secondary event after the assembly of a central galaxy, but due to their scarcity, their formation paths are not well constrained yet. We present a study of PRGs from TNG50 cosmological simulations, focusing on the origin of their polar structures. Based on the synthetic images and baryonic mass distribution, we found 6 galaxies with stellar polar rings. Using Supplementary Data Catalogues and available particle data, we confirm that the selected galaxies are direct analogs of real PRGs. In our sample, the polar structures are a result of the close interaction between the host galaxy and its companion. We track two formation paths for the stellar polar rings in our sample: (i) star formation in the accreted gas, (ii) tidal disruption of the satellite's stellar component. Rings formed during the first scenario are, on average, bluer and younger than ones formed due to the satellite disruption. We report a steady increase of the ring's inclination around the two most massive galaxies across a few billion years with a rate of $\approx8^{\circ}$/Gyr. The formation of a polar structure in some cases can increase the nuclear activity of the central galaxy and/or turn the active nucleus off completely.


title: Domain Generalisation via Risk Distribution Matching

abstract: We propose a novel approach for domain generalisation (DG) leveraging risk distributions to characterise domains, thereby achieving domain invariance. In our findings, risk distributions effectively highlight differences between training domains and reveal their inherent complexities. In testing, we may observe similar, or potentially intensifying in magnitude, divergences between risk distributions. Hence, we propose a compelling proposition: Minimising the divergences between risk distributions across training domains leads to robust invariance for DG. The key rationale behind this concept is that a model, trained on domain-invariant or stable features, may consistently produce similar risk distributions across various domains. Building upon this idea, we propose Risk Distribution Matching (RDM). Using the maximum mean discrepancy (MMD) distance, RDM aims to minimise the variance of risk distributions across training domains. However, when the number of domains increases, the direct optimisation of variance leads to linear growth in MMD computations, resulting in inefficiency. Instead, we propose an approximation that requires only one MMD computation, by aligning just two distributions: that of the worst-case domain and the aggregated distribution from all domains. Notably, this method empirically outperforms optimising distributional variance while being computationally more efficient. Unlike conventional DG matching algorithms, RDM stands out for its enhanced efficacy by concentrating on scalar risk distributions, sidestepping the pitfalls of high-dimensional challenges seen in feature or gradient matching. Our extensive experiments on standard benchmark datasets demonstrate that RDM shows superior generalisation capability over state-of-the-art DG methods.


title: Statistical manifold with degenerate metric

abstract: A statistical manifold is a pseudo-Riemannian manifold endowed with a Codazzi structure. This structure plays an important role in Information Geometry and its related fields, e.g., a statistical model admits this structure with the Fisher-Rao metric. In practical application, however, the metric may be degenerate, and then this geometric structure is not fully adapted. In the present paper, for such cases, we introduce the notice of quasi-Codazzi structure which consists of a possibly degenerate metric (i.e., symmetric $(0,2)$-tensor) and a pair of coherent tangent bundles with affine connections. This is thought of as an affine differential geometry of Lagrange subbundles of para-Hermitian vector bundles and also as a submanifold theory of para-Hermitian space-form. As a special case, the quasi-Codazzi structure with flat connections coincides with the quasi-Hessian structure previously studied by Nakajima-Ohmoto. The relation among our quasi-Codazzi structure, quasi-Hessian structure and weak contrast functions generalizes the relation among Codazzi structure, dually flat (i.e., Hessian) structure and contrast functions.


title: MILDSum: A Novel Benchmark Dataset for Multilingual Summarization of Indian Legal Case Judgments

abstract: Automatic summarization of legal case judgments is a practically important problem that has attracted substantial research efforts in many countries. In the context of the Indian judiciary, there is an additional complexity -- Indian legal case judgments are mostly written in complex English, but a significant portion of India's population lacks command of the English language. Hence, it is crucial to summarize the legal documents in Indian languages to ensure equitable access to justice. While prior research primarily focuses on summarizing legal case judgments in their source languages, this study presents a pioneering effort toward cross-lingual summarization of English legal documents into Hindi, the most frequently spoken Indian language. We construct the first high-quality legal corpus comprising of 3,122 case judgments from prominent Indian courts in English, along with their summaries in both English and Hindi, drafted by legal practitioners. We benchmark the performance of several diverse summarization approaches on our corpus and demonstrate the need for further research in cross-lingual summarization in the legal domain.


title: Online Decision Mediation

abstract: Consider learning a decision support assistant to serve as an intermediary between (oracle) expert behavior and (imperfect) human behavior: At each time, the algorithm observes an action chosen by a fallible agent, and decides whether to *accept* that agent's decision, *intervene* with an alternative, or *request* the expert's opinion. For instance, in clinical diagnosis, fully-autonomous machine behavior is often beyond ethical affordances, thus real-world decision support is often limited to monitoring and forecasting. Instead, such an intermediary would strike a prudent balance between the former (purely prescriptive) and latter (purely descriptive) approaches, while providing an efficient interface between human mistakes and expert feedback. In this work, we first formalize the sequential problem of *online decision mediation* -- that is, of simultaneously learning and evaluating mediator policies from scratch with *abstentive feedback*: In each round, deferring to the oracle obviates the risk of error, but incurs an upfront penalty, and reveals the otherwise hidden expert action as a new training data point. Second, we motivate and propose a solution that seeks to trade off (immediate) loss terms against (future) improvements in generalization error; in doing so, we identify why conventional bandit algorithms may fail. Finally, through experiments and sensitivities on a variety of datasets, we illustrate consistent gains over applicable benchmarks on performance measures with respect to the mediator policy, the learned model, and the decision-making system as a whole.


title: Device-Edge Cooperative Fine-Tuning of Foundation Models as a 6G Service

abstract: Foundation models (FoMos), referring to large-scale AI models, possess human-like capabilities and are able to perform competitively in the domain of human intelligence. The breakthrough in FoMos has inspired researchers to deploy such models in the sixth-generation (6G) mobile networks for automating a broad range of tasks in next-generation mobile applications. While the sizes of FoMos are reaching their peaks, their next phase is expected to focus on fine-tuning the models to specific downstream tasks. This inspires us to propose the vision of FoMo fine-tuning as a 6G service. Its key feature is the exploitation of existing parameter-efficient fine-tuning (PEFT) techniques to tweak only a small fraction of model weights for a FoMo to become customized for a specific task. To materialize the said vision, we survey the state-of-the-art PEFT and then present a novel device-edge fine-tuning (DEFT) framework for providing efficient and privacy-preserving fine-tuning services at the 6G network edge. The framework consists of the following comprehensive set of techniques: 1) Control of fine-tuning parameter sizes in different transformer blocks of a FoMo; 2) Over-the-air computation for realizing neural connections in DEFT; 3) Federated DEFT in a multi-device system by downloading a FoMo emulator or gradients; 4) On-the-fly prompt-ensemble tuning; 5) Device-to-device prompt transfer among devices. Experiments are conducted using pre-trained FoMos with up to 11 billion parameters to demonstrate the effectiveness of DEFT techniques. The article is concluded by presenting future research opportunities.


title: Large Language Models Are Better Adversaries: Exploring Generative Clean-Label Backdoor Attacks Against Text Classifiers

abstract: Backdoor attacks manipulate model predictions by inserting innocuous triggers into training and test data. We focus on more realistic and more challenging clean-label attacks where the adversarial training examples are correctly labeled. Our attack, LLMBkd, leverages language models to automatically insert diverse style-based triggers into texts. We also propose a poison selection technique to improve the effectiveness of both LLMBkd as well as existing textual backdoor attacks. Lastly, we describe REACT, a baseline defense to mitigate backdoor attacks via antidote training examples. Our evaluations demonstrate LLMBkd's effectiveness and efficiency, where we consistently achieve high attack success rates across a wide range of styles with little effort and no model training.


title: Anaphor Assisted Document-Level Relation Extraction

abstract: Document-level relation extraction (DocRE) involves identifying relations between entities distributed in multiple sentences within a document. Existing methods focus on building a heterogeneous document graph to model the internal structure of an entity and the external interaction between entities. However, there are two drawbacks in existing methods. On one hand, anaphor plays an important role in reasoning to identify relations between entities but is ignored by these methods. On the other hand, these methods achieve cross-sentence entity interactions implicitly by utilizing a document or sentences as intermediate nodes. Such an approach has difficulties in learning fine-grained interactions between entities across different sentences, resulting in sub-optimal performance. To address these issues, we propose an Anaphor-Assisted (AA) framework for DocRE tasks. Experimental results on the widely-used datasets demonstrate that our model achieves a new state-of-the-art performance.


title: TorchDEQ: A Library for Deep Equilibrium Models

abstract: Deep Equilibrium (DEQ) Models, an emerging class of implicit models that maps inputs to fixed points of neural networks, are of growing interest in the deep learning community. However, training and applying DEQ models is currently done in an ad-hoc fashion, with various techniques spread across the literature. In this work, we systematically revisit DEQs and present TorchDEQ, an out-of-the-box PyTorch-based library that allows users to define, train, and infer using DEQs over multiple domains with minimal code and best practices. Using TorchDEQ, we build a ``DEQ Zoo'' that supports six published implicit models across different domains. By developing a joint framework that incorporates the best practices across all models, we have substantially improved the performance, training stability, and efficiency of DEQs on ten datasets across all six projects in the DEQ Zoo. TorchDEQ and DEQ Zoo are released as \href{https://github.com/locuslab/torchdeq}{open source}.


title: Where have you been? A Study of Privacy Risk for Point-of-Interest Recommendation

abstract: As location-based services (LBS) have grown in popularity, the collection of human mobility data has become increasingly extensive to build machine learning (ML) models offering enhanced convenience to LBS users. However, the convenience comes with the risk of privacy leakage since this type of data might contain sensitive information related to user identities, such as home/work locations. Prior work focuses on protecting mobility data privacy during transmission or prior to release, lacking the privacy risk evaluation of mobility data-based ML models. To better understand and quantify the privacy leakage in mobility data-based ML models, we design a privacy attack suite containing data extraction and membership inference attacks tailored for point-of-interest (POI) recommendation models, one of the most widely used mobility data-based ML models. These attacks in our attack suite assume different adversary knowledge and aim to extract different types of sensitive information from mobility data, providing a holistic privacy risk assessment for POI recommendation models. Our experimental evaluation using two real-world mobility datasets demonstrates that current POI recommendation models are vulnerable to our attacks. We also present unique findings to understand what types of mobility data are more susceptible to privacy attacks. Finally, we evaluate defenses against these attacks and highlight future directions and challenges.


title: Simulation Study of Photon-to-Digital Converter (PDC) Timing Specifications for LoLX Experiment

abstract: The Light only Liquid Xenon (LoLX) experiment is a prototype detector aimed to study liquid xenon (LXe) light properties and various photodetection technologies. LoLX is also aimed to quantify LXe's time resolution as a potential scintillator for 10~ps time-of-flight (TOF) PET. Another key goal of LoLX is to perform a time-based separation of Cerenkov and scintillation photons for new background rejection methods in LXe experiments. To achieve this separation, LoLX is set to be equipped with photon-to-digital converters (PDCs), a photosensor type that provides a timestamp for each observed photon. To guide the PDC design, we explore requirements for time-based Cerenkov separation. We use a PDC simulator, whose input is the light information from the Geant4-based LoLX simulation model, and evaluate the separation quality against time-to-digital converter (TDC) parameters. Simulation results with TDC parameters offer possible configurations supporting a good separation. Compared with the current filter-based approach, simulations show Cerenkov separation level increases from 54% to 71% when using PDC and time-based separation. With the current photon time profile of LoLX simulation, the results also show 71% separation is achievable with just 4 TDCs per PDC. These simulation results will lead to a specification guide for the PDC as well as expected results to compare against future PDC-based experimental measurements. In the longer term, the overall LoLX results will assist large LXe-based experiments and motivate the assembly of a LXe-based TOF-PET demonstrator system.


title: Embedding in Recommender Systems: A Survey

abstract: Recommender systems have become an essential component of many online platforms, providing personalized recommendations to users. A crucial aspect is embedding techniques that coverts the high-dimensional discrete features, such as user and item IDs, into low-dimensional continuous vectors and can enhance the recommendation performance. Applying embedding techniques captures complex entity relationships and has spurred substantial research. In this survey, we provide an overview of the recent literature on embedding techniques in recommender systems. This survey covers embedding methods like collaborative filtering, self-supervised learning, and graph-based techniques. Collaborative filtering generates embeddings capturing user-item preferences, excelling in sparse data. Self-supervised methods leverage contrastive or generative learning for various tasks. Graph-based techniques like node2vec exploit complex relationships in network-rich environments. Addressing the scalability challenges inherent to embedding methods, our survey delves into innovative directions within the field of recommendation systems. These directions aim to enhance performance and reduce computational complexity, paving the way for improved recommender systems. Among these innovative approaches, we will introduce Auto Machine Learning (AutoML), hash techniques, and quantization techniques in this survey. We discuss various architectures and techniques and highlight the challenges and future directions in these aspects. This survey aims to provide a comprehensive overview of the state-of-the-art in this rapidly evolving field and serve as a useful resource for researchers and practitioners working in the area of recommender systems.


title: Deep3DSketch+: Obtaining Customized 3D Model by Single Free-Hand Sketch through Deep Learning

abstract: As 3D models become critical in today's manufacturing and product design, conventional 3D modeling approaches based on Computer-Aided Design (CAD) are labor-intensive, time-consuming, and have high demands on the creators. This work aims to introduce an alternative approach to 3D modeling by utilizing free-hand sketches to obtain desired 3D models. We introduce Deep3DSketch+, which is a deep-learning algorithm that takes the input of a single free-hand sketch and produces a complete and high-fidelity model that matches the sketch input. The neural network has view- and structural-awareness enabled by a Shape Discriminator (SD) and a Stroke Enhancement Module (SEM), which overcomes the limitations of sparsity and ambiguity of the sketches. The network design also brings high robustness to partial sketch input in industrial applications.Our approach has undergone extensive experiments, demonstrating its state-of-the-art (SOTA) performance on both synthetic and real-world datasets. These results validate the effectiveness and superiority of our method compared to existing techniques. We have demonstrated the conversion of free-hand sketches into physical 3D objects using additive manufacturing. We believe that our approach has the potential to accelerate product design and democratize customized manufacturing.


title: Optical ranging with quantum advantage

abstract: The quantum illumination technique requires joint measurement between the idler and the probe reflected from the low-reflective target present in a noisy environment. The joint measurement is only possible with prior knowledge about the target's location. The technique in this article overcomes this limitation by using entanglement and a cross-correlated homodyne measurement. This technique does not require quantum storage of the idler and prior knowledge about the target's distance. The cross-correlation measurement makes this technique completely immune to environmental noise, as the correlation between the idler and the environment is zero. The low reflectivity of the target is negated by increasing the intensity of the reference fields (non-entangled) in the homodyne. Based on heuristic arguments, a lower bound of the target's reflectivity for optimum application of this technique is described.


title: Sequential Kalman filter for fast online changepoint detection in longitudinal health records

abstract: This article introduces the sequential Kalman filter, a computationally scalable approach for online changepoint detection with temporally correlated data. The temporal correlation was not considered in the Bayesian online changepoint detection approach due to the large computational cost. Motivated by detecting COVID-19 infections for dialysis patients from massive longitudinal health records with a large number of covariates, we develop a scalable approach to detect multiple changepoints from correlated data by sequentially stitching Kalman filters of subsequences to compute the joint distribution of the observations, which has linear computational complexity with respect to the number of observations between the last detected changepoint and the current observation at each time point, without approximating the likelihood function. Compared to other online changepoint detection methods, simulated experiments show that our approach is more precise in detecting single or multiple changes in mean, variance, or correlation for temporally correlated data. Furthermore, we propose a new way to integrate classification and changepoint detection approaches that improve the detection delay and accuracy for detecting COVID-19 infection compared to other alternatives.


title: Efficient kernel surrogates for neural network-based regression

abstract: Despite their immense promise in performing a variety of learning tasks, a theoretical understanding of the limitations of Deep Neural Networks (DNNs) has so far eluded practitioners. This is partly due to the inability to determine the closed forms of the learned functions, making it harder to study their generalization properties on unseen datasets. Recent work has shown that randomly initialized DNNs in the infinite width limit converge to kernel machines relying on a Neural Tangent Kernel (NTK) with known closed form. These results suggest, and experimental evidence corroborates, that empirical kernel machines can also act as surrogates for finite width DNNs. The high computational cost of assembling the full NTK, however, makes this approach infeasible in practice, motivating the need for low-cost approximations. In the current work, we study the performance of the Conjugate Kernel (CK), an efficient approximation to the NTK that has been observed to yield fairly similar results. For the regression problem of smooth functions and logistic regression classification, we show that the CK performance is only marginally worse than that of the NTK and, in certain cases, is shown to be superior. In particular, we establish bounds for the relative test losses, verify them with numerical tests, and identify the regularity of the kernel as the key determinant of performance. In addition to providing a theoretical grounding for using CKs instead of NTKs, our framework suggests a recipe for improving DNN accuracy inexpensively. We present a demonstration of this on the foundation model GPT-2 by comparing its performance on a classification task using a conventional approach and our prescription. We also show how our approach can be used to improve physics-informed operator network training for regression tasks as well as convolutional neural network training for vision classification tasks.


title: Cobordism Obstructions to Complex Sections

abstract: A notion of vector field cobordism for oriented manifolds was defined by Bokstedt and Svane. We extend this notion to define complex section cobordism for almost complex manifolds. We then determine the complex section cobordism groups and a relevant cobordism category. We describe an obstruction which tells us when a cobordism class contains a manifold, which can be equipped with $r$ linearly independent complex sections, in terms of the Chern classes. Finally, we show that this obstruction vanishes for certain multiplicative generators in the complex cobordism ring.


title: Hierarchical Mutual Information Analysis: Towards Multi-view Clustering in The Wild

abstract: Multi-view clustering (MVC) can explore common semantics from unsupervised views generated by different sources, and thus has been extensively used in applications of practical computer vision. Due to the spatio-temporal asynchronism, multi-view data often suffer from view missing and are unaligned in real-world applications, which makes it difficult to learn consistent representations. To address the above issues, this work proposes a deep MVC framework where data recovery and alignment are fused in a hierarchically consistent way to maximize the mutual information among different views and ensure the consistency of their latent spaces. More specifically, we first leverage dual prediction to fill in missing views while achieving the instance-level alignment, and then take the contrastive reconstruction to achieve the class-level alignment. To the best of our knowledge, this could be the first successful attempt to handle the missing and unaligned data problem separately with different learning paradigms. Extensive experiments on public datasets demonstrate that our method significantly outperforms state-of-the-art methods on multi-view clustering even in the cases of view missing and unalignment.


title: Temporally Disentangled Representation Learning under Unknown Nonstationarity

abstract: In unsupervised causal representation learning for sequential data with time-delayed latent causal influences, strong identifiability results for the disentanglement of causally-related latent variables have been established in stationary settings by leveraging temporal structure. However, in nonstationary setting, existing work only partially addressed the problem by either utilizing observed auxiliary variables (e.g., class labels and/or domain indexes) as side information or assuming simplified latent causal dynamics. Both constrain the method to a limited range of scenarios. In this study, we further explored the Markov Assumption under time-delayed causally related process in nonstationary setting and showed that under mild conditions, the independent latent components can be recovered from their nonlinear mixture up to a permutation and a component-wise transformation, without the observation of auxiliary variables. We then introduce NCTRL, a principled estimation framework, to reconstruct time-delayed latent causal variables and identify their relations from measured sequential data only. Empirical evaluations demonstrated the reliable identification of time-delayed latent causal influences, with our methodology substantially outperforming existing baselines that fail to exploit the nonstationarity adequately and then, consequently, cannot distinguish distribution shifts.


title: A Generalized Statistical Model for THz wireless Channel with Random Atmospheric Absorption

abstract: Current statistical channel models for Terahertz (THz) wireless communication primarily concentrate on the sub-THz band, mostly with $\alpha$-$\mu$ and Gaussian mixture fading distributions for short-term fading and deterministic modeling for atmospheric absorption. In this paper, we develop a generalized statistical model for signal propagation at THz frequencies considering random path-loss employing Gamma distribution for the molecular absorption coefficient, short-term fading characterized by the $\alpha$-$\eta$-$\kappa$-$\mu$ distribution, antenna misalignment errors, and transceiver hardware impairments. The proposed model can handle various propagation scenarios, including indoor and outdoor environments, backhaul/fronthaul situations, and complex urban settings. Using Fox's H-functions, we present the probability density function (PDF) and cumulative distribution function (CDF) that capture the combined statistical effects of channel impairments. We analyze the outage probability of a THz link to demonstrate the analytical tractability of the proposed generalized model. We present computer simulations to demonstrate the efficacy of the proposed model for performance assessment with the statistical effect of atmospheric absorption.


title: Pessimistic Off-Policy Multi-Objective Optimization

abstract: Multi-objective optimization is a type of decision making problems where multiple conflicting objectives are optimized. We study offline optimization of multi-objective policies from data collected by an existing policy. We propose a pessimistic estimator for the multi-objective policy values that can be easily plugged into existing formulas for hypervolume computation and optimized. The estimator is based on inverse propensity scores (IPS), and improves upon a naive IPS estimator in both theory and experiments. Our analysis is general, and applies beyond our IPS estimators and methods for optimizing them. The pessimistic estimator can be optimized by policy gradients and performs well in all of our experiments.


title: Subspace projection regularization for large-scale Bayesian linear inverse problems

abstract: The Bayesian statistical framework provides a systematic approach to enhance the regularization model by incorporating prior information about the desired solution. For the Bayesian linear inverse problems with Gaussian noise and Gaussian prior, we propose a new iterative regularization algorithm that belongs to subspace projection regularization (SPR) methods. By treating the forward model matrix as a linear operator between the two underlying finite dimensional Hilbert spaces with new introduced inner products, we first introduce an iterative process that can generate a series of valid solution subspaces. The SPR method then projects the original problem onto these solution subspaces to get a series of low dimensional linear least squares problems, where an efficient procedure is developed to update the solutions of them to approximate the desired solution of the original problem. With the new designed early stopping rules, this iterative algorithm can obtain a regularized solution with a satisfied accuracy. Several theoretical results about the algorithm are established to reveal the regularization properties of it. We use both small-scale and large-scale inverse problems to test the proposed algorithm and demonstrate its robustness and efficiency. The most computationally intensive operations in the proposed algorithm only involve matrix-vector products, making it highly efficient for large-scale problems.


title: Dense Retrieval as Indirect Supervision for Large-space Decision Making

abstract: Many discriminative natural language understanding (NLU) tasks have large label spaces. Learning such a process of large-space decision making is particularly challenging due to the lack of training instances per label and the difficulty of selection among many fine-grained labels. Inspired by dense retrieval methods for passage finding in open-domain QA, we propose a reformulation of large-space discriminative NLU tasks as a learning-to-retrieve task, leading to a novel solution named Dense Decision Retrieval (DDR ). Instead of predicting fine-grained decisions as logits, DDR adopts a dual-encoder architecture that learns to predict by retrieving from a decision thesaurus. This approach not only leverages rich indirect supervision signals from easy-to-consume learning resources for dense retrieval, it also leads to enhanced prediction generalizability with a semantically meaningful representation of the large decision space. When evaluated on tasks with decision spaces ranging from hundreds to hundred-thousand scales, DDR outperforms strong baselines greatly by 27.54% in P@1 on two extreme multi-label classification tasks, 1.17% in F1 score ultra-fine entity typing, and 1.26% in accuracy on three few-shot intent classification tasks on average. Code and resources are available at https://github.com/luka-group/DDR


title: ODM3D: Alleviating Foreground Sparsity for Semi-Supervised Monocular 3D Object Detection

abstract: Monocular 3D object detection (M3OD) is a significant yet inherently challenging task in autonomous driving due to absence of explicit depth cues in a single RGB image. In this paper, we strive to boost currently underperforming monocular 3D object detectors by leveraging an abundance of unlabelled data via semi-supervised learning. Our proposed ODM3D framework entails cross-modal knowledge distillation at various levels to inject LiDAR-domain knowledge into a monocular detector during training. By identifying foreground sparsity as the main culprit behind existing methods' suboptimal training, we exploit the precise localisation information embedded in LiDAR points to enable more foreground-attentive and efficient distillation via the proposed BEV occupancy guidance mask, leading to notably improved knowledge transfer and M3OD performance. Besides, motivated by insights into why existing cross-modal GT-sampling techniques fail on our task at hand, we further design a novel cross-modal object-wise data augmentation strategy for effective RGB-LiDAR joint learning. Our method ranks 1st in both KITTI validation and test benchmarks, significantly surpassing all existing monocular methods, supervised or semi-supervised, on both BEV and 3D detection metrics.


title: Hamiltonian formulation of the RS model and field mixing

abstract: While neutrino oscillations have led to attention and research on field mixing arising from quadratic interactions, the field mixing inherent in clothed particles is more fundamental, serving as a significant source of complexity and non-perturbative challenges in quantum field theory. We present an example of an analytical solution for field mixing involving a three-point interaction between a bosonic field and a fermionic field. Specifically, we study the Rothe-Stamatescu (RS) model and utilize lattice regularization to provide a well-defined Hamiltonian which is absent in the original continuous RS model. Due to the complexity introduced by three-point interactions compared to quadratic interactions, the Fock representation commonly used in discussions of field mixing does not work well; instead, we define a representation based on real space to investigate the physical vacuum and clothed particles. These eigenstates not only reveal the field mixing between the bosonic and fermionic fields but also allow us to directly observe the spatial entanglement structure.


title: Arbitrarily Scalable Environment Generators via Neural Cellular Automata

abstract: We study the problem of generating arbitrarily large environments to improve the throughput of multi-robot systems. Prior work proposes Quality Diversity (QD) algorithms as an effective method for optimizing the environments of automated warehouses. However, these approaches optimize only relatively small environments, falling short when it comes to replicating real-world warehouse sizes. The challenge arises from the exponential increase in the search space as the environment size increases. Additionally, the previous methods have only been tested with up to 350 robots in simulations, while practical warehouses could host thousands of robots. In this paper, instead of optimizing environments, we propose to optimize Neural Cellular Automata (NCA) environment generators via QD algorithms. We train a collection of NCA generators with QD algorithms in small environments and then generate arbitrarily large environments from the generators at test time. We show that NCA environment generators maintain consistent, regularized patterns regardless of environment size, significantly enhancing the scalability of multi-robot systems in two different domains with up to 2,350 robots. Additionally, we demonstrate that our method scales a single-agent reinforcement learning policy to arbitrarily large environments with similar patterns. We include the source code at \url{https://github.com/lunjohnzhang/warehouse_env_gen_nca_public}.


title: Chow quotients of $\mathbb{C}^*$-actions

abstract: Given an action of the one-dimensional torus on a projective variety, the associated Chow quotient arises as a natural parameter space of invariant $1$-cycles, which dominates the GIT quotients of the variety. In this paper we explore the relation between the Chow and the GIT quotients of a variety, showing how to construct explicitly the former upon the latter via successive blowups under suitable assumptions. We also discuss conditions for the smoothness of the Chow quotient, and present some examples in which it is singular.


title: Block partitions in higher dimensions

abstract: Consider a set $X\subseteq \mathbb{R}^d$ which is 1-dense, namely, it intersects every unit ball. We show that we can get from any point to any other point in $\mathbb{R}^d$ in $n$ steps so that the intermediate points are in $X$, and the discrepancy of the step vectors is at most $2\sqrt{2}$, or formally, $$\sup\limits_{\substack{n\in \mathbb{Z}^+,\ t\in \mathbb{R}^d\\ X\text{ is 1-dense}}}\,\, \inf\limits_{\substack{p_1,\ldots, p_{n-1}\in X\\ p_0=\underline{0},\ p_n=t}}\,\, \max\limits_{0\leq i<j<n} \big\|(p_{i+1}-p_i)-(p_{j+1}-p_j)\big\|\leq 2\sqrt{2}.$$


title: Distributed Optimization of Clique-Wise Coupled Problems via Three-Operator Splitting

abstract: In this study, we explore distributed optimization problems with clique-wise coupling through the lens of operator splitting. This framework of clique-wise coupling extends beyond conventional pairwise coupled problems, encompassing consensus optimization and formation control, and is applicable to a wide array of examples. We first introduce a matrix, called the clique-wise duplication (CD) matrix, which enables decoupled reformulations for operator splitting methods and distributed computation. Leveraging this matrix, we propose a new distributed optimization algorithm via Davis-Yin splitting (DYS), a versatile three-operator splitting method. We then delve into the properties of this method and demonstrate how existing consensus optimization methods (NIDS, Exact Diffusion, and Diffusion) can be derived from our proposed method. Furthermore, being inspired by this observation, we derive a Diffusion-like method, the clique-based projected gradient descent (CPGD), and present Nesterov's acceleration and in-depth convergence analysis for various step sizes. The paper concludes with numerical examples that underscore the efficacy of our proposed method.


title: Benchmark Generation Framework with Customizable Distortions for Image Classifier Robustness

abstract: We present a novel framework for generating adversarial benchmarks to evaluate the robustness of image classification models. Our framework allows users to customize the types of distortions to be optimally applied to images, which helps address the specific distortions relevant to their deployment. The benchmark can generate datasets at various distortion levels to assess the robustness of different image classifiers. Our results show that the adversarial samples generated by our framework with any of the image classification models, like ResNet-50, Inception-V3, and VGG-16, are effective and transferable to other models causing them to fail. These failures happen even when these models are adversarially retrained using state-of-the-art techniques, demonstrating the generalizability of our adversarial samples. We achieve competitive performance in terms of net $L_2$ distortion compared to state-of-the-art benchmark techniques on CIFAR-10 and ImageNet; however, we demonstrate our framework achieves such results with simple distortions like Gaussian noise without introducing unnatural artifacts or color bleeds. This is made possible by a model-based reinforcement learning (RL) agent and a technique that reduces a deep tree search of the image for model sensitivity to perturbations, to a one-level analysis and action. The flexibility of choosing distortions and setting classification probability thresholds for multiple classes makes our framework suitable for algorithmic audits.


title: Constraints of internal symmetry on the non-Hermitian skin effect and bidirectional skin effect under the action of the Hermitian conjugate of time-reversal symmetry

abstract: Non-Hermitian skin effect is a basic phenomenon in non-Hermitian system, which means that an extensive number of eigenstates can be localized at the boundary. In this Letter, we systematically investigate the constraints from all internal symmetries on the non-Hermitian skin effect in arbitrary dimensions. By adopting the powerful Amoeba formulation, we build a generic correspondence between the various internal symmetries and the behavior of the non-Hermitian skin effect. Notably, we find that, for non-Hermitian systems with the time-reversal$^\dagger$ symmetry, the eigenstates can simultaneously localize at opposite boundaries, which is beyond the Amoeba formulation, and we dub the phenomenon bidirectional skin effect. Our work provides an overall perspective from the internal symmetry to the non-Hermitian skin effect.


title: Personalised Distillation: Empowering Open-Sourced LLMs with Adaptive Learning for Code Generation

abstract: With the rise of powerful closed-sourced LLMs (ChatGPT, GPT-4), there are increasing interests in distilling the capabilies of close-sourced LLMs to smaller open-sourced LLMs. Previous distillation methods usually prompt ChatGPT to generate a set of instructions and answers, for the student model to learn. However, such standard distillation approach neglects the merits and conditions of the student model. Inspired by modern teaching principles, we design a personalised distillation process, in which the student attempts to solve a task first, then the teacher provides an adaptive refinement for the student to improve. Instead of feeding the student with teacher's prior, personalised distillation enables personalised learning for the student model, as it only learns on examples it makes mistakes upon and learns to improve its own solution. On code generation, personalised distillation consistently outperforms standard distillation with only one third of the data. With only 2.5-3K personalised examples that incur a data-collection cost of 4-6$, we boost CodeGen-mono-16B by 7% to achieve 36.4% pass@1 and StarCoder by 12.2% to achieve 45.8% pass@1 on HumanEval.


title: Explainable Modeling for Wind Power Forecasting: A Glass-Box Approach with High Accuracy

abstract: Machine learning models (e.g., neural networks) achieve high accuracy in wind power forecasting, but they are usually regarded as black boxes that lack interpretability. To address this issue, the paper proposes a glass-box approach that combines high accuracy with transparency for wind power forecasting. Specifically, the core is to sum up the feature effects by constructing shape functions, which effectively map the intricate non-linear relationships between wind power output and input features. Furthermore, the forecasting model is enriched by incorporating interaction terms that adeptly capture interdependencies and synergies among the input features. The additive nature of the proposed glass-box approach ensures its interpretability. Simulation results show that the proposed glass-box approach effectively interprets the results of wind power forecasting from both global and instance perspectives. Besides, it outperforms most benchmark models and exhibits comparable performance to the best-performing neural networks. This dual strength of transparency and high accuracy positions the proposed glass-box approach as a compelling choice for reliable wind power forecasting.


title: Joint Localization and Communication Enhancement in Uplink Integrated Sensing and Communications System with Clock Asynchronism

abstract: In this paper, we propose a joint single-base localization and communication enhancement scheme for the uplink (UL) integrated sensing and communications (ISAC) system with asynchronism, which can achieve accurate single-base localization of user equipment (UE) and significantly improve the communication reliability despite the existence of timing offset (TO) due to the clock asynchronism between UE and base station (BS). Our proposed scheme integrates the CSI enhancement into the multiple signal classification (MUSIC)-based AoA estimation and thus imposes no extra complexity on the ISAC system. We further exploit a MUSIC-based range estimation method and prove that it can suppress the time-varying TO-related phase terms. Exploiting the AoA and range estimation of UE, we can estimate the location of UE. Finally, we propose a joint CSI and data signals-based localization scheme that can coherently exploit the data and the CSI signals to improve the AoA and range estimation, which further enhances the single-base localization of UE. The extensive simulation results show that the enhanced CSI can achieve equivalent bit error rate performance to the minimum mean square error (MMSE) CSI estimator. The proposed joint CSI and data signals-based localization scheme can achieve decimeter-level localization accuracy despite the existing clock asynchronism and improve the localization mean square error (MSE) by about 8 dB compared with the maximum likelihood (ML)-based benchmark method.


title: Shortcuts to Adiabatic Soliton Compression in Active Nonlinear Kerr Media

abstract: We implement variational shortcuts to adiabaticity for optical pulse compression in an active nonlinear Kerr medium with distributed amplification and spatially varying dispersion and nonlinearity. Starting with the hyperbolic secant ansatz, we employ a variational approximation to systematically derive dynamical equations, establishing analytical relationships linking the amplitude, width, and chirp of the pulse. Through the inverse engineering approach, we manipulate the distributed gain/loss, nonlinearity and dispersion profiles to efficiently compress the optical pulse over a reduced distance with high fidelity. In addition, we explore the dynamical stability of the system to illustrate the advantage of our protocol over conventional adiabatic approaches. Finally, we analyze the impact of tailored higher-order dispersion on soliton self-compression and derive physical constraints on the final soliton width for the complementary case of soliton expansion. The broader implications of our findings extend beyond optical systems, encompassing areas such as cold-atom and magnetic systems highlighting the versatility and relevance of our approach in various physical contexts.


title: Asymptotic expansion for additive measure of branching Brownian motion

abstract: Let $N(t)$ be the collection of particles alive at time $t$ in a branching Brownian motion in $\mathbb{R}^d$, and for $u\in N(t)$, let $\mathbf{X}_u(t)$ be the position of particle $u$ at time $t$. For $\theta\in \mathbb{R}^d$, we define the additive measures of the branching Brownian motion by$$\mu_t^\theta (\mathrm{d}\mathbf{x}):= e^{-(1+\frac{\Vert\theta\Vert^2}{2})t}\sum_{u\in N(t)} e^{-\theta \cdot \mathbf{X}_u(t)} \delta_{\left(\mathbf{X}_u(t)+\theta t\right)}(\mathrm{d}\mathbf{x}).$$ In this paper, under some conditions on the offspring distribution, we give asymptotic expansions of arbitrary order for $\mu_t^\theta ((\mathbf{a}, \mathbf{b}])$ and $\mu_t^\theta ((-\infty, \mathbf{a}])$ for $\theta\in \mathbb{R}^d$ with $\Vert \theta \Vert <\sqrt{2}$. These expansions sharpen the asymptotic results of Asmussen and Kaplan (1976) and Kang (1999), and are analogs of the expansions in Gao and Liu (2021) and R\'{e}v\'{e}sz, Rosen and Shi (2005) for branching Wiener processes (a particular class of branching random walks) corresponding to $\theta=\mathbf{0}$.


title: Setting the Trap: Capturing and Defeating Backdoors in Pretrained Language Models through Honeypots

abstract: In the field of natural language processing, the prevalent approach involves fine-tuning pretrained language models (PLMs) using local samples. Recent research has exposed the susceptibility of PLMs to backdoor attacks, wherein the adversaries can embed malicious prediction behaviors by manipulating a few training samples. In this study, our objective is to develop a backdoor-resistant tuning procedure that yields a backdoor-free model, no matter whether the fine-tuning dataset contains poisoned samples. To this end, we propose and integrate a honeypot module into the original PLM, specifically designed to absorb backdoor information exclusively. Our design is motivated by the observation that lower-layer representations in PLMs carry sufficient backdoor features while carrying minimal information about the original tasks. Consequently, we can impose penalties on the information acquired by the honeypot module to inhibit backdoor creation during the fine-tuning process of the stem network. Comprehensive experiments conducted on benchmark datasets substantiate the effectiveness and robustness of our defensive strategy. Notably, these results indicate a substantial reduction in the attack success rate ranging from 10\% to 40\% when compared to prior state-of-the-art methods.


title: SSL Framework for Causal Inconsistency between Structures and Representations

abstract: The cross-pollination of deep learning and causal discovery has catalyzed a burgeoning field of research seeking to elucidate causal relationships within non-statistical data forms like images, videos, and text. Such data, often being named `indefinite data', exhibit unique challenges-inconsistency between causal structure and representation, which are not common in conventional data forms. To tackle this issue, we theoretically develop intervention strategies suitable for indefinite data and derive causal consistency condition (CCC). Moreover, we design a self-supervised learning (SSL) framework that considers interventions as `views' and CCC as a `philosophy' with two implement examples on Supervised Specialized Models (SSMs) and Large Language Models (LLMs), respectively. To evaluate pure inconsistency manifestations, we have prepared the first high-quality causal dialogue dataset-Causalogue. Evaluations are also performed on three other downstream tasks. Extensive experimentation has substantiated the efficacy of our methodology, illuminating how CCC could potentially play an influential role in various fields.


title: T-PickSeer: Visual Analysis of Taxi Pick-up Point Selection Behavior

abstract: Taxi drivers often take much time to navigate the streets to look for passengers, which leads to high vacancy rates and wasted resources. Empty taxi cruising remains a big concern for taxi companies. Analyzing the pick-up point selection behavior can solve this problem effectively, providing suggestions for taxi management and dispatch. Many studies have been devoted to analyzing and recommending hot-spot regions of pick-up points, which can make it easier for drivers to pick up passengers. However, the selection of pick-up points is complex and affected by multiple factors, such as convenience and traffic management. Most existing approaches cannot produce satisfactory results in real-world applications because of the changing travel demands and the lack of interpretability. In this paper, we introduce a visual analytics system, T-PickSeer, for taxi company analysts to better explore and understand the pick-up point selection behavior of passengers. We explore massive taxi GPS data and employ an overview-to-detail approach to enable effective analysis of pick-up point selection. Our system provides coordinated views to compare different regularities and characteristics in different regions. Also, our system assists in identifying potential pick-up points and checking the performance of each pick-up point. Three case studies based on a real-world dataset and interviews with experts have demonstrated the effectiveness of our system.


title: Electrical Impedance Tomography: A Fair Comparative Study on Deep Learning and Analytic-based Approaches

abstract: Electrical Impedance Tomography (EIT) is a powerful imaging technique with diverse applications, e.g., medical diagnosis, industrial monitoring, and environmental studies. The EIT inverse problem is about inferring the internal conductivity distribution of an object from measurements taken on its boundary. It is severely ill-posed, necessitating advanced computational methods for accurate image reconstructions. Recent years have witnessed significant progress, driven by innovations in analytic-based approaches and deep learning. This review explores techniques for solving the EIT inverse problem, focusing on the interplay between contemporary deep learning-based strategies and classical analytic-based methods. Four state-of-the-art deep learning algorithms are rigorously examined, harnessing the representational capabilities of deep neural networks to reconstruct intricate conductivity distributions. In parallel, two analytic-based methods, rooted in mathematical formulations and regularisation techniques, are dissected for their strengths and limitations. These methodologies are evaluated through various numerical experiments, encompassing diverse scenarios that reflect real-world complexities. A suite of performance metrics is employed to assess the efficacy of these methods. These metrics collectively provide a nuanced understanding of the methods' ability to capture essential features and delineate complex conductivity patterns. One novel feature of the study is the incorporation of variable conductivity scenarios, introducing a level of heterogeneity that mimics textured inclusions. This departure from uniform conductivity assumptions mimics realistic scenarios where tissues or materials exhibit spatially varying electrical properties. Exploring how each method responds to such variable conductivity scenarios opens avenues for understanding their robustness and adaptability.


title: Asymptotic independence for random permutations from surface groups

abstract: Let $X$ be an orientable hyperbolic surface of genus $g\geq 2$ with a marked point $o$, and let $\Gamma$ be an orientable hyperbolic surface group isomorphic to $\pi_{1}(X,o)$. Consider the space $\text{Hom}(\Gamma,S_{n})$ which corresponds to $n$-sheeted covers of $X$ with labeled fiber. Given $\gamma\in\Gamma$ and a uniformly random $\phi\in\text{Hom}(\Gamma,S_{n})$, what is the expected number of fixed points of $\phi(\gamma)$? Formally, let $F_{n}(\gamma)$ denote the number of fixed points of $\phi(\gamma)$ for a uniformly random $\phi\in\text{Hom}(\Gamma,S_{n})$. We think of $F_{n}(\gamma)$ as a random variable on the space $\text{Hom}(\Gamma,S_{n})$. We show that an arbitrary fixed number of products of the variables $F_{n}(\gamma)$ are asymptotically independent as $n\to\infty$ when there are no obvious obstructions. We also determine the limiting distribution of such products. Additionally, we examine short cycle statistics in random permutations of the form $\phi(\gamma)$ for a uniformly random $\phi\in\text{Hom}(\Gamma,S_{n})$. We show a similar asymptotic independence result and determine the limiting distribution.


title: Causal effects of the Fed's large-scale asset purchases on firms' capital structure

abstract: We investigate the short- and long-term impacts of the Federal Reserve's large-scale asset purchases (LSAPs) on non-financial firms' capital structure using a threshold panel ARDL model. To isolate the effects of LSAPs from other macroeconomic conditions, we interact firm- and industry-specific indicators of debt capacity with measures of LSAPs. We find that LSAPs facilitated firms' access to external financing, with both Treasury and MBS purchases having positive effects. Our model also allows us to estimate the time profile of the effects of LSAPs on firm leverage providing robust evidence that they are long-lasting. These effects have a half-life of 4-5 quarters and a mean lag length of about six quarters. Nevertheless, the magnitudes are small, suggesting that LSAPs have contributed only marginally to the rise in U.S. corporate debt ratios of the past decade.


title: Towards Plastic and Stable Exemplar-Free Incremental Learning: A Dual-Learner Framework with Cumulative Parameter Averaging

abstract: The dilemma between plasticity and stability presents a significant challenge in Incremental Learning (IL), especially in the exemplar-free scenario where accessing old-task samples is strictly prohibited during the learning of a new task. A straightforward solution to this issue is learning and storing an independent model for each task, known as Single Task Learning (STL). Despite the linear growth in model storage with the number of tasks in STL, we empirically discover that averaging these model parameters can potentially preserve knowledge across all tasks. Inspired by this observation, we propose a Dual-Learner framework with Cumulative Parameter Averaging (DLCPA). DLCPA employs a dual-learner design: a plastic learner focused on acquiring new-task knowledge and a stable learner responsible for accumulating all learned knowledge. The knowledge from the plastic learner is transferred to the stable learner via cumulative parameter averaging. Additionally, several task-specific classifiers work in cooperation with the stable learner to yield the final prediction. Specifically, when learning a new task, these modules are updated in a cyclic manner: i) the plastic learner is initially optimized using a self-supervised loss besides the supervised loss to enhance the feature extraction robustness; ii) the stable learner is then updated with respect to the plastic learner in a cumulative parameter averaging manner to maintain its task-wise generalization; iii) the task-specific classifier is accordingly optimized to align with the stable learner. Experimental results on CIFAR-100 and Tiny-ImageNet show that DLCPA outperforms several state-of-the-art exemplar-free baselines in both Task-IL and Class-IL settings.


title: Switching Temporary Teachers for Semi-Supervised Semantic Segmentation

abstract: The teacher-student framework, prevalent in semi-supervised semantic segmentation, mainly employs the exponential moving average (EMA) to update a single teacher's weights based on the student's. However, EMA updates raise a problem in that the weights of the teacher and student are getting coupled, causing a potential performance bottleneck. Furthermore, this problem may become more severe when training with more complicated labels such as segmentation masks but with few annotated data. This paper introduces Dual Teacher, a simple yet effective approach that employs dual temporary teachers aiming to alleviate the coupling problem for the student. The temporary teachers work in shifts and are progressively improved, so consistently prevent the teacher and student from becoming excessively close. Specifically, the temporary teachers periodically take turns generating pseudo-labels to train a student model and maintain the distinct characteristics of the student model for each epoch. Consequently, Dual Teacher achieves competitive performance on the PASCAL VOC, Cityscapes, and ADE20K benchmarks with remarkably shorter training times than state-of-the-art methods. Moreover, we demonstrate that our approach is model-agnostic and compatible with both CNN- and Transformer-based models. Code is available at \url{https://github.com/naver-ai/dual-teacher}.


title: Varying magnetism in the lattice distorted Y2NiIrO6 and La2NiIrO6

abstract: We investigate the electronic and magnetic properties of the newly synthesized double perovskites Y$_{2}$NiIrO$_{6}$ and La$_{2}$NiIrO$_{6}$, using density functional calculations, crystal field theory, superexchange pictures, and Monte Carlo simulations. We find that both systems are antiferromagnetic (AFM) Mott insulators, with the high-spin Ni$^{2+}$ $t_{2g}$$^{6}e_{g}$$^{2}$ ($S=1$) and the low-spin Ir$^{4+}$ $t_{2g}$$^{5}$ ($S=1/2$) configurations. We address that their lattice distortion induces $t_{2g}$-$e_{g}$ orbital mixing and thus enables the normal Ni$^{+}$-Ir$^{5+}$ charge excitation with the electron hopping from the Ir `$t_{2g}$' to Ni `$e_g$' orbitals, which promotes the AFM Ni$^{2+}$-Ir$^{4+}$ coupling. Therefore, the increasing $t_{2g}$-$e_{g}$ mixing accounts for the enhanced $T_{\rm N}$ from the less distorted La$_{2}$NiIrO$_{6}$ to the more distorted Y$_{2}$NiIrO$_{6}$. Moreover, our test calculations find that in the otherwise ideally cubic Y$_{2}$NiIrO$_{6}$, the Ni$^{+}$-Ir$^{5+}$ charge excitation is forbidden, and only the abnormal Ni$^{3+}$-Ir$^{3+}$ excitation gives a weakly ferromagnetic (FM) behavior. Furthermore, we find that owing to the crystal field splitting, Hund exchange, and broad band formation in the highly coordinated fcc sublattice, Ir$^{4+}$ ions are not in the $j_{\rm eff}=1/2$ state but in the $S=1/2$ state carrying a finite orbital moment by spin-orbit coupling (SOC). This work clarifies the varying magnetism in Y$_{2}$NiIrO$_{6}$ and La$_{2}$NiIrO$_{6}$ associated with the lattice distortions.


title: One-shot Localization and Segmentation of Medical Images with Foundation Models

abstract: Recent advances in Vision Transformers (ViT) and Stable Diffusion (SD) models with their ability to capture rich semantic features of the image have been used for image correspondence tasks on natural images. In this paper, we examine the ability of a variety of pre-trained ViT (DINO, DINOv2, SAM, CLIP) and SD models, trained exclusively on natural images, for solving the correspondence problems on medical images. While many works have made a case for in-domain training, we show that the models trained on natural images can offer good performance on medical images across different modalities (CT,MR,Ultrasound) sourced from various manufacturers, over multiple anatomical regions (brain, thorax, abdomen, extremities), and on wide variety of tasks. Further, we leverage the correspondence with respect to a template image to prompt a Segment Anything (SAM) model to arrive at single shot segmentation, achieving dice range of 62%-90% across tasks, using just one image as reference. We also show that our single-shot method outperforms the recently proposed few-shot segmentation method - UniverSeg (Dice range 47%-80%) on most of the semantic segmentation tasks(six out of seven) across medical imaging modalities.


title: The Simultaneous Lattice Packing-Covering Constant of Octahedra

abstract: This paper proves that the simultaneous lattice packing-covering constant of an octahedron is $7/6$. In other words, $7/6$ is the smallest positive number $r$ such that for every octahedron $O$ centered at the origin there is a lattice $\Lambda$ such that $O+\Lambda$ is a packing in $\mathbb{E}^3$ and $rO+\Lambda$ is a covering of $\mathbb{E}^3$.


title: Structural and magnetic properties of $\beta$-Li$_2$IrO$_3$ after grazing-angle focused ion beam thinning

abstract: Manipulating the size and orientation of quantum materials is often used to tune emergent phenomena, but precise control of these parameters is also necessary from an experimental point of view. Various synthesis techniques already exist, such as epitaxial thin film growth and chemical etching, that are capable of producing specific sample dimensions with high precision. However, certain materials exist as single crystals that are often difficult to manipulate, thereby limiting their studies to a certain subset of experimental techniques. One particular class of these materials are the lithium and sodium iridates that are promising candidates for hosting a Kitaev quantum spin liquid state. Here we present a controlled method of using a focused ion beam at grazing incidence to reduce the size of a $\beta$-Li$_2$IrO$_3$ single crystal to a thickness of 1 $\mu m$. Subsequent x-ray diffraction measurements show the lattice remains intact, albeit with a larger mosaic spread. The integrity of the magnetic order is also preserved as the temperature dependent magnetic diffraction peak follows the same trend as its bulk counterpart with a transition temperature at TN = 37.5 K. Our study demonstrates a technique that opens up the possibility of nonequilibrium experiments where submicron thin samples are often essential.


title: Experimental verification of the steering ellipsoid zoo via two-qubit states

abstract: Quantum steering ellipsoid visualizes the set of all qubit states that can be steered by measuring on another correlated qubit in the Bloch picture. Together with local reduced states, it provides a faithful geometric characterization of the underlying two-qubit state so that almost all nonclassical state features can be reflected in its geometric properties. Consequently, the various types of quantum ellipsoids with different geometric properties form an ellipsoid zoo, which, in this work, is experimentally verified via measurements on many polarization-path photonic states. By generating two-qubit states with high fidelity, the corresponding ellipsoids are constructed to certify the presence of entanglement, one-way Einstein-Podolsky-Rosen steering, discord, and steering incompleteness. It is also experimentally verified that the steering ellipsoid can be reconstructed from using the twelve vertices of the icosahedron as measurement directions. Our results aid progress in applying the quantum steering ellipsoid to reveal nonclassical features of the multi-qubit system.


title: Predicting Agricultural Commodities Prices with Machine Learning: A Review of Current Research

abstract: Agricultural price prediction is crucial for farmers, policymakers, and other stakeholders in the agricultural sector. However, it is a challenging task due to the complex and dynamic nature of agricultural markets. Machine learning algorithms have the potential to revolutionize agricultural price prediction by improving accuracy, real-time prediction, customization, and integration. This paper reviews recent research on machine learning algorithms for agricultural price prediction. We discuss the importance of agriculture in developing countries and the problems associated with crop price falls. We then identify the challenges of predicting agricultural prices and highlight how machine learning algorithms can support better prediction. Next, we present a comprehensive analysis of recent research, discussing the strengths and weaknesses of various machine learning techniques. We conclude that machine learning has the potential to revolutionize agricultural price prediction, but further research is essential to address the limitations and challenges associated with this approach.