title: Regularized Linear Regression for Binary Classification

abstract: Regularized linear regression is a promising approach for binary classification problems in which the training set has noisy labels since the regularization term can help to avoid interpolating the mislabeled data points. In this paper we provide a systematic study of the effects of the regularization strength on the performance of linear classifiers that are trained to solve binary classification problems by minimizing a regularized least-squares objective. We consider the over-parametrized regime and assume that the classes are generated from a Gaussian Mixture Model (GMM) where a fraction $c<\frac{1}{2}$ of the training data is mislabeled. Under these assumptions, we rigorously analyze the classification errors resulting from the application of ridge, $\ell_1$, and $\ell_\infty$ regression. In particular, we demonstrate that ridge regression invariably improves the classification error. We prove that $\ell_1$ regularization induces sparsity and observe that in many cases one can sparsify the solution by up to two orders of magnitude without any considerable loss of performance, even though the GMM has no underlying sparsity structure. For $\ell_\infty$ regularization we show that, for large enough regularization strength, the optimal weights concentrate around two values of opposite sign. We observe that in many cases the corresponding "compression" of each weight to a single bit leads to very little loss in performance. These latter observations can have significant practical ramifications.


title: FaMeSumm: Investigating and Improving Faithfulness of Medical Summarization

abstract: Summaries of medical text shall be faithful by being consistent and factual with source inputs, which is an important but understudied topic for safety and efficiency in healthcare. In this paper, we investigate and improve faithfulness in summarization on a broad range of medical summarization tasks. Our investigation reveals that current summarization models often produce unfaithful outputs for medical input text. We then introduce FaMeSumm, a framework to improve faithfulness by fine-tuning pre-trained language models based on medical knowledge. FaMeSumm performs contrastive learning on designed sets of faithful and unfaithful summaries, and it incorporates medical terms and their contexts to encourage faithful generation of medical terms. We conduct comprehensive experiments on three datasets in two languages: health question and radiology report summarization datasets in English, and a patient-doctor dialogue dataset in Chinese. Results demonstrate that FaMeSumm is flexible and effective by delivering consistent improvements over mainstream language models such as BART, T5, mT5, and PEGASUS, yielding state-of-the-art performances on metrics for faithfulness and general quality. Human evaluation by doctors also shows that FaMeSumm generates more faithful outputs. Our code is available at https://github.com/psunlpgroup/FaMeSumm .


title: Enabling Cross-Language Data Integration and Scalable Analytics in Decentralized Finance

abstract: With the agile development process of most academic and corporate entities, designing a robust computational back-end system that can support their ever-changing data needs is a constantly evolving challenge. We propose the implementation of a data and language-agnostic system design that handles different data schemes and sources while subsequently providing researchers and developers a way to connect to it that is supported by a vast majority of programming languages. To validate the efficacy of a system with this proposed architecture, we integrate various data sources throughout the decentralized finance (DeFi) space, specifically from DeFi lending protocols, retrieving tens of millions of data points to perform analytics through this system. We then access and process the retrieved data through several different programming languages (R-Lang, Python, and Java). Finally, we analyze the performance of the proposed architecture in relation to other high-performance systems and explore how this system performs under a high computational load.


title: A Sequential Learning Procedure with Applications to Online Sales Examination

abstract: In this paper, we consider the problem of estimating parameters in a linear regression model. We propose a sequential learning procedure to determine the sample size for achieving a given small estimation risk, under the widely used Gauss-Markov setup with independent normal errors. The procedure is proven to enjoy the second-order efficiency and risk-efficiency properties, which are validated through Monte Carlo simulation studies. Using e-commerce data, we implement the procedure to examine the influential factors of online sales.


title: Patch-based Selection and Refinement for Early Object Detection

abstract: Early object detection (OD) is a crucial task for the safety of many dynamic systems. Current OD algorithms have limited success for small objects at a long distance. To improve the accuracy and efficiency of such a task, we propose a novel set of algorithms that divide the image into patches, select patches with objects at various scales, elaborate the details of a small object, and detect it as early as possible. Our approach is built upon a transformer-based network and integrates the diffusion model to improve the detection accuracy. As demonstrated on BDD100K, our algorithms enhance the mAP for small objects from 1.03 to 8.93, and reduce the data volume in computation by more than 77\%. The source code is available at \href{https://github.com/destiny301/dpr}{https://github.com/destiny301/dpr}


title: Topographically-generated near-internal waves as a response to winds over the ocean surface

abstract: Internal waves propagate on the ocean stratification and carry energy and momentum through the ocean interior. The two most significant sources of these waves in the ocean are surface winds and oscillatory tidal flow across topography. We propose a hybrid of these two mechanisms, in which wind induced oscillations of sea surface and isopycnal heights are rapidly communicated to the seafloor via hydrostatic pressure. In the presence of topography, the resulting oscillatory bottom velocity may then generate internal waves in a similar manner to the barotropic tide. We investigate this mechanism in an idealised numerical isopycnal model of a storm passing over a mid ocean ridge, and perform several perturbation experiments in which ocean and wind properties are varied. Bottom-generated internal waves are identified propagating away from the ridge in the wake of the storm. Estimates of the total wave energy suggest that in the right circumstances these waves could be a significant source of internal wave energy, with a local wind work to wave energy conversion rate of up to 50% of the corresponding conversion to surface generated near-inertial waves in our domain. Our results suggest a need for further investigation in less idealised scenarios to more precisely quantity this novel mechanism of deep ocean wave generation, and how it may affect abyssal mixing.


title: $\text{L}^2$ solutions for cubic NLS equation with fractional elliptic/hyperbolic operators on $\mathbb{R}\times\mathbb{T}$ and $\mathbb{R}^2$

abstract: In this work we consider the Cauchy problem for the cubic Schr\"odinger equation posed on cylinder $\mathbb{R}\times\mathbb{T}$ with fractional derivatives $(-\partial_y^2)^{\alpha},\, \alpha >0$, in the periodic direction. The spatial operator includes elliptic and hyperbolic regimes. We prove $L^2$ global well-posedness results when $\alpha > 1$ by proving a $L^4 - L^2$ Strichartz inequality for the linear equation, following the ideas developep by H. Takaoka and N. Tzvetkov in the the case of the Laplacian operator. Further, these results remain valid on the euclidean environment $\mathbb{R}^2$, so well-posedness in $L^2$ are also achieved in this case. Our proof in the elliptic (hyperbolic) case does not work in the case $0<\alpha <1$ ($0<\alpha \leq 1$), respectively.


title: HASHI: Highly Adaptable Seafood Handling Instrument for Manipulation in Industrial Settings

abstract: The seafood processing industry provides fertile ground for robotics to impact the future-of-work from multiple perspectives including productivity, worker safety, and quality of work life. The robotics research challenge is the realization of flexible and reliable manipulation of soft, deformable, slippery, spiky and scaly objects. In this paper, we propose a novel robot end effector, called HASHI, that employs chopstick-like appendages for precise and dexterous manipulation. This gripper is capable of in-hand manipulation by rotating its two constituent sticks relative to each other and offers control of objects in all three axes of rotation by imitating human use of chopsticks. HASHI delicately positions and orients food through embedded 6-axis force-torque sensors. We derive and validate the kinematic model for HASHI, as well as demonstrate grip force and torque readings from the sensorization of each chopstick. We also evaluate the versatility of HASHI through grasping trials of a variety of real and simulated food items with varying geometry, weight, and firmness.


title: Machine learning's own Industrial Revolution

abstract: Machine learning is expected to enable the next Industrial Revolution. However, lacking standardized and automated assembly networks, ML faces significant challenges to meet ever-growing enterprise demands and empower broad industries. In the Perspective, we argue that ML needs to first complete its own Industrial Revolution, elaborate on how to best achieve its goals, and discuss new opportunities to enable rapid translation from ML's innovation frontier to mass production and utilization.


title: Algorithms for Proportional Representation in Parliament in Divisor and Multiplicative Form

abstract: We consider three algorithms for allocating parliamentary seats by proportional representation. The usual approach to describing such algorithms is to compute a quota of votes that each party uses to "acquire'' representatives. This kind of description follows a divisor method, since the number of representatives for a party is equal to the number of votes for that party, divided by the quota. We show that a simple multiplicative form with different rounding methods produces algorithms equivalent to the divisor methods. The multiplicative form is intuitive and easier to understand for a wider audience.


title: Criticality and Chaos in Auditory and Vestibular Sensing

abstract: The auditory and vestibular systems exhibit remarkable sensitivity of detection, responding to deflections on the order of Angstroms, even in the presence of biological noise. Further, these complex systems exhibit high temporal acuity and frequency selectivity, allowing us to make sense of the acoustic world around us. As this acoustic environment of interest spans several orders of magnitude in both amplitude and frequency, these systems rely heavily on nonlinearities and power-law scaling. The behavior of these sensory systems has been extensively studied in the context of dynamical systems theory, with many empirical phenomena described by critical dynamics. Other phenomena have been explained by systems in the chaotic regime, where weak perturbations drastically impact the future state of the system. We first review the conceptual framework behind these two types of detectors, as well as the detection features that they can capture. We then explore the intersection of the two types of systems and propose ideal parameter regimes for auditory and vestibular systems.


title: Simulating the photospheric to coronal plasma using magnetohydrodyanamic characteristics I: data-driven boundary conditions

abstract: We develop a general description of how information propagates through a magnetohydrodynamic (MHD) system based on the method of characteristics and use that to formulate numerical boundary conditions (BCs) that are intrinsically consistent with the MHD equations. Our formulation includes two major advances for simulations of the Sun. First, we derive data-driven BCs that optimally match the state of the plasma inferred from a time series of observations of a boundary (e.g., the solar photosphere). Second, our method directly handles random noise and systematic bias in the observations, and finds a solution for the boundary evolution that is strictly consistent with MHD and maximally consistent with the observations. We validate the method against a Ground Truth (GT) simulation of an expanding spheromak. The data-driven simulation can reproduce the GT simulation above the photosphere with high fidelity when driven at high cadence. Errors progressively increase for lower driving cadence until a threshold cadence is reached and the driven simulation can no longer accurately reproduce the GT simulation. However, our characteristic formulation of the BCs still requires adherence of the boundary evolution to the MHD equations even when the driven solution departs from the true solution in the driving layer. That increasing departure clearly indicates when additional information at the boundary is needed to fully specify the correct evolution of the system. The method functions even when no information about the evolution of some variables on the lower boundary is available, albeit with a further decrease in fidelity.


title: Contrastive Multi-Modal Representation Learning for Spark Plug Fault Diagnosis

abstract: Due to the incapability of one sensory measurement to provide enough information for condition monitoring of some complex engineered industrial mechanisms and also for overcoming the misleading noise of a single sensor, multiple sensors are installed to improve the condition monitoring of some industrial equipment. Therefore, an efficient data fusion strategy is demanded. In this research, we presented a Denoising Multi-Modal Autoencoder with a unique training strategy based on contrastive learning paradigm, both being utilized for the first time in the machine health monitoring realm. The presented approach, which leverages the merits of both supervised and unsupervised learning, not only achieves excellent performance in fusing multiple modalities (or views) of data into an enriched common representation but also takes data fusion to the next level wherein one of the views can be omitted during inference time with very slight performance reduction, or even without any reduction at all. The presented methodology enables multi-modal fault diagnosis systems to perform more robustly in case of sensor failure occurrence, and one can also intentionally omit one of the sensors (the more expensive one) in order to build a more cost-effective condition monitoring system without sacrificing performance for practical purposes. The effectiveness of the presented methodology is examined on a real-world private multi-modal dataset gathered under non-laboratory conditions from a complex engineered mechanism, an inline four-stroke spark-ignition engine, aiming for spark plug fault diagnosis. This dataset, which contains the accelerometer and acoustic signals as two modalities, has a very slight amount of fault, and achieving good performance on such a dataset promises that the presented method can perform well on other equipment as well.


title: Objectives Are All You Need: Solving Deceptive Problems Without Explicit Diversity Maintenance

abstract: Navigating deceptive domains has often been a challenge in machine learning due to search algorithms getting stuck at sub-optimal local optima. Many algorithms have been proposed to navigate these domains by explicitly maintaining diversity or equivalently promoting exploration, such as Novelty Search or other so-called Quality Diversity algorithms. In this paper, we present an approach with promise to solve deceptive domains without explicit diversity maintenance by optimizing a potentially large set of defined objectives. These objectives can be extracted directly from the environment by sub-aggregating the raw performance of individuals in a variety of ways. We use lexicase selection to optimize for these objectives as it has been shown to implicitly maintain population diversity. We compare this technique with a varying number of objectives to a commonly used quality diversity algorithm, MAP-Elites, on a set of discrete optimization as well as reinforcement learning domains with varying degrees of deception. We find that decomposing objectives into many objectives and optimizing them outperforms MAP-Elites on the deceptive domains that we explore. Furthermore, we find that this technique results in competitive performance on the diversity-focused metrics of QD-Score and Coverage, without explicitly optimizing for these things. Our ablation study shows that this technique is robust to different subaggregation techniques. However, when it comes to non-deceptive, or ``illumination" domains, quality diversity techniques generally outperform our objective-based framework with respect to exploration (but not exploitation), hinting at potential directions for future work.


title: Vacuum effects induced by a plate in de Sitter spacetime in the presence of a cosmic string

abstract: In this paper we investigate the vacuum expectation values of the field squared and the energy-momentum tensor associated to a charged massive scalar quantum field in a $(1+D)$-dimensional de Sitter spacetime induced by a plate (flat boundary) and a carrying-magnetic-flux cosmic string. In our analysis we admit that the flat boundary is perpendicular to the string, and the scalar field obeys the Robin boundary condition on the plate. In order to do develop this analysis, we obtain the complete set of normalized positive-energy solution of the Klein-Gordon equation compatible with the model setup. Having obtained these bosonic modes, we construct the corresponding Wightman function. The latter is given by the sum of two terms: one associated with the boundary-free spacetime, and the other induced by the flat boundary. Although we have imposed the Robin boundary condition on the field, we apply our formalism considering specifically the Dirichlet and Neumann boundary conditions. The corresponding parts have opposite signs. Because the analysis of bosonic vacuum polarization in boundary-free de Sitter space and in presence of a cosmic string, in some sense, has been developed in the literature, here we are mainly interested in the calculations of the effects induced by the boundary. In this way, closed expressions for the corresponding expectation values are provided, as well as their asymptotic behavior in different limiting regions. We show that the conical topology due to the cosmic string enhances the boundary induced vacuum polarization effects for both field squared and the energy-momentum tensor, compared to the case of a boundary in pure de Sitter spacetime. Moreover, the presence of cosmic string and boundary induce non-zero stress along the direction normal to the boundary. The corresponding vacuum force acting on the boundary is also investigated.


title: Refined nuclear magnetic octupole moment of $^{113}$In and $^{115}$In

abstract: The refined values of the magnetic octupole moments of $^{113}$In and $^{115}$In are obtained by combining high-precision atomic calculations with corresponding hyperfine structure spectrum. We performed an \textit{ab initio }calculations of hyperfine-structure properties for the low-lying states of In atom using the single and double approximated relativistic coupled-cluster method. The hyperfine-structure properties includes first-order hyperfine-structure constants and the second-order magnetic dipole-magnetic dipole, magnetic dipole-electric quadrupole, and electric quadrupole-electric quadrupole effects caused by the off-diagonal hyperfine interaction. Based on our theoretical results, we reanalyze the previously measurements of hyperfine splitting in the 5$p_{3/2}$ state of $^{113}$In and $^{115}$In [Eck and Kusch, Phys. Rev. 106, 958 (1957)], determining corresponding hyperfine-structure constants $A$, $B$, and $C$. By combining these undated HFS constants and our theoretical results, the magnetic octupole moments of $^{113}$In and $^{115}$In nuclei are extracted to be $\Omega(^{113}\rm In)=0.455(44)$~$\mathrm{\mu_{N}\times b}$ , and $\Omega(^{115}\rm In)=0.443(42)$~$\mathrm{\mu_{N}\times b}$, respectively. The refined values of magnetic octupole moments are about smaller 21\% than the previously reported results by Eck and Kusch [Phys. Rev. 106, 958 (1957)]. Additionally, we also determine the electric quadrupole moment of $^{115}$In nuclei to be $Q(^{115}\rm In)=0.767(9)$ b by combining our theoretical results and the measured values for hyperfine-structure constants of the 5$p_{3/2}$ and 6$p_{3/2}$ states. Our results are compared with available experimental and theoretical results.


title: Small-scale Dynamo in Cool Stars III. Changes in the photospheres of F3V to M0V stars

abstract: Some of the quiet solar magnetic flux could be attributed to a small-scale dynamo (SSD) operating in the convection zone. An SSD operating in cool main-sequence stars is expected to affect the atmospheric structure, in particular the convection, and should have observational signatures. We aim to investigate the distribution of these fields as well as their effect on intensity characteristics, velocities and spatial distribution of kinetic (KE) and magnetic energy (ME) in the lower photosphere of spectral types F3V, G2V, K0V and M0V using 3D radiative-MHD simulations. PDFs of field strength at the $\tau=1$ surface are quite similar for all cases. The M0V star displays the strongest fields, but relative to the gas pressure, the fields on the F3V star reach the largest values. All stars display an excess of horizontal field relative to vertical field in the middle photosphere, with this excess becoming increasingly prominent towards later spectral types. These fields result in a decrease in upflow velocities, slightly smaller granules as well as the formation of bright points in intergranular lanes. The spatial distribution of KE and ME is also similar for all cases, implying a simple pressure scale height proportionality of important scales. SSD fields have rather similar effects on the photospheres of cool main-sequence stars, namely, a significant reduction in convective velocities as well as a slight reduction in granule size, and concentration of field to kG levels in intergranular lanes associated with the formation of bright points. The distribution of field strengths and energies is also rather similar.


title: Predicting Ground Reaction Force from Inertial Sensors

abstract: The study of ground reaction forces (GRF) is used to characterize the mechanical loading experienced by individuals in movements such as running, which is clinically applicable to identify athletes at risk for stress-related injuries. Our aim in this paper is to determine if data collected with inertial measurement units (IMUs), that can be worn by athletes during outdoor runs, can be used to predict GRF with sufficient accuracy to allow the analysis of its derived biomechanical variables (e.g., contact time and loading rate). In this paper, we consider lightweight approaches in contrast to state-of-the-art prediction using LSTM neural networks. Specifically, we compare use of LSTMs to k-Nearest Neighbors (KNN) regression as well as propose a novel solution, SVD Embedding Regression (SER), using linear regression between singular value decomposition embeddings of IMUs data (input) and GRF data (output). We evaluate the accuracy of these techniques when using training data collected from different athletes, from the same athlete, or both, and we explore the use of acceleration and angular velocity data from sensors at different locations (sacrum and shanks). Our results illustrate that simple machine learning methods such as SER and KNN can be similarly accurate or more accurate than LSTM neural networks, with much faster training times and hyperparameter optimization; in particular, SER and KNN are more accurate when personal training data are available, and KNN comes with benefit of providing provenance of prediction. Notably, the use of personal data reduces prediction errors of all methods for most biomechanical variables.


title: OverHear: Headphone based Multi-sensor Keystroke Inference

abstract: Headphones, traditionally limited to audio playback, have evolved to integrate sensors like high-definition microphones and accelerometers. While these advancements enhance user experience, they also introduce potential eavesdropping vulnerabilities, with keystroke inference being our concern in this work. To validate this threat, we developed OverHear, a keystroke inference framework that leverages both acoustic and accelerometer data from headphones. The accelerometer data, while not sufficiently detailed for individual keystroke identification, aids in clustering key presses by hand position. Concurrently, the acoustic data undergoes analysis to extract Mel Frequency Cepstral Coefficients (MFCC), aiding in distinguishing between different keystrokes. These features feed into machine learning models for keystroke prediction, with results further refined via dictionary-based word prediction methods. In our experimental setup, we tested various keyboard types under different environmental conditions. We were able to achieve top-5 key prediction accuracy of around 80% for mechanical keyboards and around 60% for membrane keyboards with top-100 word prediction accuracies over 70% for all keyboard types. The results highlight the effectiveness and limitations of our approach in the context of real-world scenarios.


title: Fidelity and variability in the interlayer electronic structure of the kagome superconductor CsV3Sb5

abstract: The AV3Sb5 (A = K, Rb, Cs) kagome materials host an interplay of emergent phenomena including superconductivity, charge density wave states, and non-trivial electronic structure topology. The band structures of these materials exhibit a rich variety of features like Dirac crossings, saddle points associated with van Hove singularities, and flat bands prompting significant investigations into the in-plane electronic behavior. However, recent findings including the charge density wave ordering and effects due to pressure or chemical doping point to the importance of understanding interactions between kagome layers. Probing this c-axis electronic structure via experimental methods remains challenging due to limitations of the crystals and, therefore, rigorous computational approaches are necessary to study the interlayer interactions. Here we use first-principles approaches to study the electronic structure of CsV3Sb5 with emphasis on the kz dispersion. We find that the inclusion of nonlocal and dynamical many-body correlation has a substantial impact on the interlayer band structure. We present new band behavior that additionally supports the integration of symmetry in accurately plotting electronic structures and influences further analysis like the calculation of topological invariants.


title: A Physics based Machine Learning Model to characterize Room Temperature Semiconductor Detectors in 3D

abstract: Room temperature semiconductor radiation detectors (RTSD) for X-ray and gamma-ray detection are vital tools for medical imaging, astrophysics and other applications. CdZnTe (CZT) has been the main RTSD for more than three decades with desired detection properties. In a typical pixelated configuration, CZT have electrodes on opposite ends. For advanced event reconstruction algorithms at sub-pixel level, detailed characterization of the RTSD is required in three dimensional (3D) space. However, 3D characterization of the material defects and charge transport properties in the sub-pixel regime is a labor-intensive process with skilled manpower and novel experimental setups. Presently, state-of-art characterization is done over the bulk of the RTSD considering homogenous properties. In this paper, we propose a novel physics based machine learning (PBML) model to characterize the RTSD over a discretized sub-pixelated 3D volume which is assumed. Our novel approach is the first to characterize a full 3D charge transport model of the RTSD. In this work, we first discretize the RTSD between a pixelated electrodes spatially in 3D - x, y, and z. The resulting discretizations are termed as voxels in 3D space. In each voxel, the different physics based charge transport properties such as drift, trapping, detrapping and recombination of charges are modeled as trainable model weights. The drift of the charges considers second order non-linear motion which is observed in practice with the RTSDs. Based on the electron-hole pair injections as input to the PBML model, and signals at the electrodes, free and trapped charges (electrons and holes) as outputs of the model, the PBML model determines the trainable weights by backpropagating the loss function. The trained weights of the model represents one-to-one relation to that of the actual physical charge transport properties in a voxelized detector.


title: A Survey of the Various Methodologies Towards making Artificial Intelligence More Explainable

abstract: Machines are being increasingly used in decision-making processes, resulting in the realization that decisions need explanations. Unfortunately, an increasing number of these deployed models are of a 'black-box' nature where the reasoning behind the decisions is unknown. Hence, there is a need for clarity behind the reasoning of these decisions. As humans, we would want these decisions to be presented to us in an explainable manner. However, explanations alone are insufficient. They do not necessarily tell us how to achieve an outcome but merely tell us what achieves the given outcome. For this reason, my research focuses on explainability/interpretability and how it extends to counterfactual thinking.


title: Decoherence time control by interconnection for finite-level quantum memory systems

abstract: This paper is concerned with open quantum systems whose dynamic variables have an algebraic structure, similar to that of the Pauli matrices for finite-level systems. The Hamiltonian and the operators of coupling of the system to the external bosonic fields depend linearly on the system variables. The fields are represented by quantum Wiener processes which drive the system dynamics according to a quasilinear Hudson-Parthasarathy quantum stochastic differential equation whose drift vector and dispersion matrix are affine and linear functions of the system variables. This setting includes the zero-Hamiltonian isolated system dynamics as a particular case, where the system variables are constant in time, which makes them potentially applicable as a quantum memory. In a more realistic case of nonvanishing system-field coupling, we define a memory decoherence time when a mean-square deviation of the system variables from their initial values becomes relatively significant as specified by a weighting matrix and a fidelity parameter. We consider the decoherence time maximization over the energy parameters of the system and obtain a condition under which the zero Hamiltonian provides a suboptimal solution. This optimization problem is also discussed for a direct energy coupling interconnection of such systems.


title: SMIwiz: An integrated toolbox for multidimensional seismic modelling and imaging

abstract: This paper contributes an open source software - SMIwiz, which integrates seismic modelling, reverse time migration (RTM), and full waveform inversion (FWI) into a unified computer implementation. SMIwiz has the machinery to do both 2D and 3D simulation in a consistent manner. The package features a number of computational recipes for efficient calculation of imaging condition and inversion gradient: a dynmaic evolving computing box to limit the simulation cube and a well-designed wavefield reconstruction strategy to reduce the memory consumption when dealing with 3D problems. The modelling in SMIwiz runs independently: each shot corresponds to one processor in a bijective manner to maximize the scalability. A batchwise job scheduling strategy is designed to handle large 3D imaging tasks on computer with limited number of cores. The viability of SMIwiz is demonstrated by a number of applications on benchmark models.


title: LLMs grasp morality in concept

abstract: Work in AI ethics and fairness has made much progress in regulating LLMs to reflect certain values, such as fairness, truth, and diversity. However, it has taken the problem of how LLMs might 'mean' anything at all for granted. Without addressing this, it is not clear what imbuing LLMs with such values even means. In response, we provide a general theory of meaning that extends beyond humans. We use this theory to explicate the precise nature of LLMs as meaning-agents. We suggest that the LLM, by virtue of its position as a meaning-agent, already grasps the constructions of human society (e.g. morality, gender, and race) in concept. Consequently, under certain ethical frameworks, currently popular methods for model alignment are limited at best and counterproductive at worst. Moreover, unaligned models may help us better develop our moral and social philosophy.


title: On the irreducibility and weakly homogeneity of a class of operators

abstract: To construct more homogeneous operators, B. Bagchi and G. Misra in \cite{d} introduced the operator $\left(\begin{smallmatrix} T_0 & T_0-T_1 \\ 0 & T_1\\ \end{smallmatrix}\right)$ and proved that when $T_0$ and $T_1$ are homogeneous operators with the same unitary representation $U(g)$, it is homogeneous with associated representation $U(g)\oplus U(g)$. At the same time, they asked an open question, is the constructed operator irreducible? A. Kor$\acute{a}$nyi in \cite{e} showed that when the (1,2)-entry of the matrix is $\alpha(T_0-T_1)$, $\alpha\in\mathbb{C}$ the above result is also valid, and their unitary equivalence class depends only on $|\alpha|$. In this case, he and S. Hazra \cite{f} gave a large class of irreducible homogeneous bilateral $2\times2$ block shifts, respectively, which are mutually unitarily inequivalent for $\alpha>0$. In this note, we generalize the construction to $T=\left(\begin{smallmatrix} T_0 & XT_1-T_0X \\ 0 & T_1\\ \end{smallmatrix}\right)$ and provide some sufficient conditions for its irreducibility. We also find that for the above-mentioned $T_0,T_1$ and non-scalar operator $X$, $T$ is weakly homogeneous rather than homogeneous. So the weak homogeneity problem related to $T$ is investigated.


title: Survey of Simulators for Aerial Robots

abstract: Uncrewed Aerial Vehicle (UAV) research faces challenges with safety, scalability, costs, and ecological impact when conducting hardware testing. High-fidelity simulators offer a vital solution by replicating real-world conditions to enable the development and evaluation of novel perception and control algorithms. However, the large number of available simulators poses a significant challenge for researchers to determine which simulator best suits their specific use-case, based on each simulator's limitations and customization readiness. In this paper we present an overview of 43 UAV simulators, including in-depth, systematic comparisons for 17 of the simulators. Additionally, we present a set of decision factors for selection of simulators, aiming to enhance the efficiency and safety of research endeavors.


title: Candidate Members of the VMP/EMP Disk System of the Galaxy from the SkyMapper and SAGES Surveys

abstract: Photometric stellar surveys now cover a large fraction of the sky, probe to fainter magnitudes than large-scale spectroscopic surveys, and are relatively free from the target-selection biases often associated with such studies. Photometric-metallicity estimates that include narrow/medium-band filters can achieve comparable accuracy and precision to existing low-resolution spectroscopic surveys such as SDSS/SEGUE and LAMOST. Here we report on an effort to identify likely members of the Galactic disk system among the very metal-poor (VMP; [Fe/H] $\leq$ --2) and extremely metal-poor (EMP; [Fe/H] $\leq$ --3) stars. Our analysis is based on an initial sample of $\sim11.5$ million stars with full space motions selected from the SkyMapper Southern Survey (SMSS) and Stellar Abundance and Galactic Evolution Survey (SAGES). After applying a number of quality cuts to obtain the best available metallicity and dynamical estimates, we analyze a total of $\sim$5.86 million stars in the combined SMSS/SAGES sample. We employ two techniques that, depending on the method, identify between 876 and 1,476 VMP stars (6.9%-11.7% of all VMP stars) and between 40 and 59 EMP stars (12.4%-18.3% of all EMP stars) that appear to be members of the Galactic disk system on highly prograde orbits (v$_{\phi} > 150$ km/s). The total number of candidate VMP/EMP disk-like stars is 1,496, the majority of which have low orbital eccentricities, ecc $\le 0.4$; many have ecc $\le 0.2$. The large fractions of VMP/EMP stars associated with the Milky Way disk system strongly suggest the presence of an early forming ``primordial" disk.


title: 3D seismic survey design by maximizing the spectral gap

abstract: The massive cost of 3D acquisition calls for methods to reduce the number of receivers by designing optimal receiver sampling masks. Recent studies on 2D seismic showed that maximizing the spectral gap of the subsampling mask leads to better wavefield reconstruction results. We enrich the current study by proposing a simulation-free method to generate optimal 3D acquisition by maximizing the spectral gap of the subsampling mask via a simulated annealing algorithm. Numerical experiments confirm improvement of the proposed method over receiver sampling locations obtained by jittered sampling.


title: The Fragility of Sparsity

abstract: We show, using three empirical applications, that linear regression estimates which rely on the assumption of sparsity are fragile in two ways. First, we document that different choices of the regressor matrix that do not impact ordinary least squares (OLS) estimates, such as the choice of baseline category with categorical controls, can move sparsity-based estimates two standard errors or more. Second, we develop two tests of the sparsity assumption based on comparing sparsity-based estimators with OLS. The tests tend to reject the sparsity assumption in all three applications. Unless the number of regressors is comparable to or exceeds the sample size, OLS yields more robust results at little efficiency cost.


title: Successive Model-Agnostic Meta-Learning for Few-Shot Fault Time Series Prognosis

abstract: Meta learning is a promising technique for solving few-shot fault prediction problems, which have attracted the attention of many researchers in recent years. Existing meta-learning methods for time series prediction, which predominantly rely on random and similarity matching-based task partitioning, face three major limitations: (1) feature exploitation inefficiency; (2) suboptimal task data allocation; and (3) limited robustness with small samples. To overcome these limitations, we introduce a novel 'pseudo meta-task' partitioning scheme that treats a continuous time period of a time series as a meta-task, composed of multiple successive short time periods. Employing continuous time series as pseudo meta-tasks allows our method to extract more comprehensive features and relationships from the data, resulting in more accurate predictions. Moreover, we introduce a differential algorithm to enhance the robustness of our method across different datasets. Through extensive experiments on several fault and time series prediction datasets, we demonstrate that our approach substantially enhances prediction performance and generalization capability under both few-shot and general conditions.


title: Geometrizing the Partial Entanglement Entropy: from PEE Threads to Bit Threads

abstract: We give a scheme to geometrize the partial entanglement entropy (PEE) for holographic CFT in the context of AdS/CFT. More explicitly, given a point $\textbf{x}$ we geometrize the two-point PEEs between $\textbf{x}$ and any other points in terms of the bulk geodesics connecting these two points. We refer to these geodesics as the \textit{PEE threads}, which can be naturally regarded as the integral curves of a divergenceless vector field $V_{\textbf{x}}^{\mu}$, which we call \emph{PEE thread flow}. The norm of $V_{\textbf{x}}^{\mu}$ that characterizes the density of the PEE threads can be determined by some physical requirements of the PEE. We show that, for any static interval or spherical region $A$, a unique bit thread configuration can be generated from the PEE thread configuration determined by the state. Hence, the non-intrinsic bit threads are emergent from the intrinsic PEE threads. For static disconnected intervals, the vector fields describing a divergenceless flow is are longer suitable to reproduce the RT formula. We weight the PEE threads with the number of times it intersects with any homologous surface. Instead the RT formula is perfectly reformulated to be the minimization of the summation of the PEE threads with all possible assignment of weights.


title: Proactively incremental-learning QAOA

abstract: Solving optimization problems with high performance is the target of existing works of Quantum Approximate Optimization Algorithm (QAOA). With this intention, we propose an advanced QAOA based on incremental learning, where the training trajectory is proactively segmented into incremental phases. Taking the MaxCut problem as our example, we randomly select a small subgraph from the whole graph and train the quantum circuit to get optimized parameters for the MaxCut of the subgraph in the first phase. Then in each subsequent incremental phase, a portion of the remaining nodes and edges are added to the current subgraph, and the circuit is retrained to get new optimized parameters. The above operation is repeated until the MaxCut problem on the whole graph is solved. The key point is that the optimized parameters of the previous phase will be reused in the initial parameters of the current phase. Numerous simulation experiments show our method has superior performance on Approximation Ratio (AR) and training time compared to prevalent works of QAOA. Specifically, the AR is higher than standard QAOA by 13.17% on weighted random graphs.


title: MFTCoder: Boosting Code LLMs with Multitask Fine-Tuning

abstract: Code LLMs have emerged as a specialized research field, with remarkable studies dedicated to enhancing model's coding capabilities through fine-tuning on pre-trained models. Previous fine-tuning approaches were typically tailored to specific downstream tasks or scenarios, which meant separate fine-tuning for each task, requiring extensive training resources and posing challenges in terms of deployment and maintenance. Furthermore, these approaches failed to leverage the inherent interconnectedness among different code-related tasks. To overcome these limitations, we present a multi-task fine-tuning framework, MFTcoder, that enables simultaneous and parallel fine-tuning on multiple tasks. By incorporating various loss functions, we effectively address common challenges in multi-task learning, such as data imbalance, varying difficulty levels, and inconsistent convergence speeds. Extensive experiments have conclusively demonstrated that our multi-task fine-tuning approach outperforms both individual fine-tuning on single tasks and fine-tuning on a mixed ensemble of tasks. Moreover, MFTcoder offers efficient training capabilities, including efficient data tokenization modes and PEFT fine-tuning, resulting in significantly improved speed compared to traditional fine-tuning methods. MFTcoder seamlessly integrates with several mainstream open-source LLMs, such as CodeLLama and Qwen. Leveraging the CodeLLama foundation, our MFTcoder fine-tuned model, \textsc{CodeFuse-CodeLLama-34B}, achieves an impressive pass@1 score of 74.4\% on the HumaneEval benchmark, surpassing GPT-4 performance (67\%, zero-shot). MFTCoder is open-sourced at \url{https://github.com/codefuse-ai/MFTCOder}


title: Imitating and Finetuning Model Predictive Control for Robust and Symmetric Quadrupedal Locomotion

abstract: Control of legged robots is a challenging problem that has been investigated by different approaches, such as model-based control and learning algorithms. This work proposes a novel Imitating and Finetuning Model Predictive Control (IFM) framework to take the strengths of both approaches. Our framework first develops a conventional model predictive controller (MPC) using Differential Dynamic Programming and Raibert heuristic, which serves as an expert policy. Then we train a clone of the MPC using imitation learning to make the controller learnable. Finally, we leverage deep reinforcement learning with limited exploration for further finetuning the policy on more challenging terrains. By conducting comprehensive simulation and hardware experiments, we demonstrate that the proposed IFM framework can significantly improve the performance of the given MPC controller on rough, slippery, and conveyor terrains that require careful coordination of footsteps. We also showcase that IFM can efficiently produce more symmetric, periodic, and energy-efficient gaits compared to Vanilla RL with a minimal burden of reward shaping.


title: OSM vs HD Maps: Map Representations for Trajectory Prediction

abstract: While High Definition (HD) Maps have long been favored for their precise depictions of static road elements, their accessibility constraints and susceptibility to rapid environmental changes impede the widespread deployment of autonomous driving, especially in the motion forecasting task. In this context, we propose to leverage OpenStreetMap (OSM) as a promising alternative to HD Maps for long-term motion forecasting. The contributions of this work are threefold: firstly, we extend the application of OSM to long-horizon forecasting, doubling the forecasting horizon compared to previous studies. Secondly, through an expanded receptive field and the integration of intersection priors, our OSM-based approach exhibits competitive performance, narrowing the gap with HD Map-based models. Lastly, we conduct an exhaustive context-aware analysis, providing deeper insights in motion forecasting across diverse scenarios as well as conducting class-aware comparisons. This research not only advances long-term motion forecasting with coarse map representations but additionally offers a potential scalable solution within the domain of autonomous driving.


title: Heteroskedastic Tensor Clustering

abstract: Tensor clustering, which seeks to extract underlying cluster structures from noisy tensor observations, has gained increasing attention. One extensively studied model for tensor clustering is the tensor block model, which postulates the existence of clustering structures along each mode and has found broad applications in areas like multi-tissue gene expression analysis and multilayer network analysis. However, currently available computationally feasible methods for tensor clustering either are limited to handling i.i.d. sub-Gaussian noise or suffer from suboptimal statistical performance, which restrains their utility in applications that have to deal with heteroskedastic data and/or low signal-to-noise-ratio (SNR). To overcome these challenges, we propose a two-stage method, named $\mathsf{High\text{-}order~HeteroClustering}$ ($\mathsf{HHC}$), which starts by performing tensor subspace estimation via a novel spectral algorithm called $\mathsf{Thresholded~Deflated\text{-}HeteroPCA}$, followed by approximate $k$-means to obtain cluster nodes. Encouragingly, our algorithm provably achieves exact clustering as long as the SNR exceeds the computational limit (ignoring logarithmic factors); here, the SNR refers to the ratio of the pairwise disparity between nodes to the noise level, and the computational limit indicates the lowest SNR that enables exact clustering with polynomial runtime. Comprehensive simulation and real-data experiments suggest that our algorithm outperforms existing algorithms across various settings, delivering more reliable clustering performance.

categories: math.ST cs.IT cs.LG math.IT stat.ME stat.ML stat.TH


title: Coalescence sum rule and the electric charge- and strangeness-dependences of directed flow in heavy ion collisions

abstract: The rapidity-odd directed flows ($v_{\rm 1}$) of identified hadrons are expected to follow the coalescence sum rule when the created matter is initially in parton degrees of freedom and then hadronizes through quark coalescence. A recent study has considered the $v_{\rm 1}$ of produced hadrons that do not contain $u$ or $d$ constituent quarks. It has constructed multiple hadron sets with a small mass difference but given difference in electric charge $\Delta q$ and strangeness $\Delta S$ between the two sides, where a nonzero and increasing $\Delta v_{\rm 1}$ with $\Delta q$ has been proposed to be a consequence of electromagnetic fields. In this study, we examine the consequence of coalescence sum rule on the $\Delta v_{\rm 1}$ of the hadron sets in the absence of electromagnetic fields. We find that in general $\Delta v_{\rm 1} \neq 0$ for a hadron set with nonzero $\Delta q$ and/or $\Delta S$ due to potential $v_{\rm 1}$ differences between $\bar u$ and $\bar d$ and between $s$ and $\bar s$ quarks. We further propose methods to extract the coefficients for the $\Delta q$- and $\Delta S$-dependences of the direct flow difference, where a nonzero constant term would indicate the breaking of the coalescence sum rule. The extraction methods are then demonstrated with transport model results.


title: Kernel-based sensitivity indices for any model behavior and screening

abstract: Complex models are often used to understand interactions and drivers of human-induced and/or natural phenomena. It is worth identifying the input variables that drive the model output(s) in a given domain and/or govern specific model behaviors such as contextual indicators based on socio-environmental models. Using the theory of multivariate weighted distributions to characterize specific model behaviors, we propose new measures of association between inputs and such behaviors. Our measures rely on sensitivity functionals (SFs) and kernel methods, including variance-based sensitivity analysis. The proposed $\ell_1$-based kernel indices account for interactions among inputs, higher-order moments of SFs, and their upper bounds are somehow equivalent to the Morris-type screening measures, including dependent elementary effects. Empirical kernel-based indices are derived, including their statistical properties for the computational issues, and numerical results are provided.


title: Focused helium ion and electron beam induced deposition of organometallic tips for dynamic AFM of biomolecules in liquid

abstract: We demonstrate the fabrication of sharp nanopillars of high aspect ratio onto specialized atomic force microscopy (AFM) microcantilevers and their use for high-speed AFM of DNA and nucleoproteins in liquid. The fabrication technique uses localized charged-particle-induced deposition with either a focused beam of helium ions or electrons in a helium ion microscope (HIM) or scanning electron microscope (SEM). This approach enables customized growth onto delicate substrates with nanometer-scale placement precision and in-situ imaging of the final tip structures using the HIM or SEM. Tip radii of <10 nm are obtained and the underlying microcantilever remains intact. Instead of the more commonly used organic precursors employed for bio-AFM applications, we use an organometallic precursor (tungsten hexacarbonyl) resulting in tungsten-containing tips. Transmission electron microscopy reveals a thin layer of carbon on the tips. Consequently, the interaction of the new tips with biological specimens is likely very similar to that of standard carbonaceous tips, with the added benefit of robustness. A further advantage of the organometallic tips is that compared to carbonaceous tips they better withstand UV-ozone cleaning treatments to remove residual organic contaminants between experiments. Such contaminants are unavoidable during the scanning of soft biomolecules in liquid. Our tips can also be grown onto the blunted tips of previously-used cantilevers, thus providing a means to recycle specialized cantilevers and restore their performance to the original manufacturer specifications. Finally, a focused helium ion beam milling technique to reduce the tip radii and thus further improve lateral spatial resolution in the AFM scans is demonstrated.


title: Narrowing the Gap between Zero- and Few-shot Machine Translation by Matching Styles

abstract: Large language models trained primarily in a monolingual setting have demonstrated their ability to generalize to machine translation using zero- and few-shot examples with in-context learning. However, even though zero-shot translations are relatively good, there remains a discernible gap comparing their performance with the few-shot setting. In this paper, we investigate the factors contributing to this gap and find that this gap can largely be closed (for about 70%) by matching the writing styles of the target corpus. Additionally, we explore potential approaches to enhance zero-shot baselines without the need for parallel demonstration examples, providing valuable insights into how these methods contribute to improving translation metrics.


title: A Brief Survey of Open Radio Access Network (O-RAN) Security

abstract: Open Radio Access Network (O-RAN), a novel architecture that separates the traditional radio access network (RAN) into multiple disaggregated components, leads a revolution in the telecommunication ecosystems. Compared to the traditional RAN, the proposed O-RAN paradigm is more flexible and more cost-effective for the operators, vendors, and the public. The key design considerations of O-RAN include virtualization and intelligent capabilities in order to meet the new requirements of 5G. However, because of the open nature and the newly imported techniques in O-RAN architecture, the assessment of the security in O-RAN architecture during its early development stage is crucial. This project aims to present an investigation of the current ORAN architecture from several attack surfaces, including (1) Architectural openness, (2) Cloud and Virtualization, (3) Network slicing, and (4) Machine Learning. The existing attack surfaces and corresponding mitigation methods of these attacks are also surveyed and provided in this report, serving as a guiding principle and valuable recommendation for the O-RAN implementers and framework designers.


title: Efficient Change Point Detection and Estimation in High-Dimensional Correlation Matrices

abstract: This paper considers the problems of detecting a change point and estimating the location in the correlation matrices of a sequence of high-dimensional vectors, where the dimension is large enough to be comparable to the sample size or even much larger. A new break test is proposed based on signflip parallel analysis to detect the existence of change points. Furthermore, a two-step approach combining a signflip permutation dimension reduction step and a CUSUM statistic is proposed to estimate the change point's location and recover the support of changes. The consistency of the estimator is constructed. Simulation examples and real data applications illustrate the superior empirical performance of the proposed methods. Especially, the proposed methods outperform existing ones for non-Gaussian data and the change point in the extreme tail of a sequence and become more accurate as the dimension p increases. Supplementary materials for this article are available online.


title: LISNeRF Mapping: LiDAR-based Implicit Mapping via Semantic Neural Fields for Large-Scale 3D Scenes

abstract: Large-scale semantic mapping is crucial for outdoor autonomous agents to fulfill high-level tasks such as planning and navigation. This paper proposes a novel method for large-scale 3D semantic reconstruction through implicit representations from posed LiDAR measurements alone. We first leverage an octree-based and hierarchical structure to store implicit features, then these implicit features are decoded to semantic information and signed distance value through shallow Multilayer Perceptrons (MLPs). We adopt off-the-shelf algorithms to predict the semantic labels and instance IDs of point clouds. We then jointly optimize the feature embeddings and MLPs parameters with a self-supervision paradigm for point cloud geometry and a pseudo-supervision paradigm for semantic and panoptic labels. Subsequently, categories and geometric structures for novel points are regressed, and marching cubes are exploited to subdivide and visualize the scenes in the inferring stage. For scenarios with memory constraints, a map stitching strategy is also developed to merge sub-maps into a complete map. Experiments on two real-world datasets, SemanticKITTI and SemanticPOSS, demonstrate the superior segmentation efficiency and mapping effectiveness of our framework compared to current state-of-the-art 3D LiDAR mapping methods.


title: Thermal Face Image Classification using Deep Learning Techniques

abstract: Thermal images have various applications in security, medical and industrial domains. This paper proposes a practical deep-learning approach for thermal image classification. Accurate and efficient classification of thermal images poses a significant challenge across various fields due to the complex image content and the scarcity of annotated datasets. This work uses a convolutional neural network (CNN) architecture, specifically ResNet-50 and VGGNet-19, to extract features from thermal images. This work also applied Kalman filter on thermal input images for image denoising. The experimental results demonstrate the effectiveness of the proposed approach in terms of accuracy and efficiency.


title: Counting Manatee Aggregations using Deep Neural Networks and Anisotropic Gaussian Kernel

abstract: Manatees are aquatic mammals with voracious appetites. They rely on sea grass as the main food source, and often spend up to eight hours a day grazing. They move slow and frequently stay in group (i.e. aggregations) in shallow water to search for food, making them vulnerable to environment change and other risks. Accurate counting manatee aggregations within a region is not only biologically meaningful in observing their habit, but also crucial for designing safety rules for human boaters, divers, etc., as well as scheduling nursing, intervention, and other plans. In this paper, we propose a deep learning based crowd counting approach to automatically count number of manatees within a region, by using low quality images as input. Because manatees have unique shape and they often stay in shallow water in groups, water surface reflection, occlusion, camouflage etc. making it difficult to accurately count manatee numbers. To address the challenges, we propose to use Anisotropic Gaussian Kernel (AGK), with tunable rotation and variances, to ensure that density functions can maximally capture shapes of individual manatees in different aggregations. After that, we apply AGK kernel to different types of deep neural networks primarily designed for crowd counting, including VGG, SANet, Congested Scene Recognition network (CSRNet), MARUNet etc. to learn manatee densities and calculate number of manatees in the scene. By using generic low quality images extracted from surveillance videos, our experiment results and comparison show that AGK kernel based manatee counting achieves minimum Mean Absolute Error (MAE) and Root Mean Square Error (RMSE). The proposed method works particularly well for counting manatee aggregations in environments with complex background.


title: Self-Supervised Learning of Representations for Space Generates Multi-Modular Grid Cells

abstract: To solve the spatial problems of mapping, localization and navigation, the mammalian lineage has developed striking spatial representations. One important spatial representation is the Nobel-prize winning grid cells: neurons that represent self-location, a local and aperiodic quantity, with seemingly bizarre non-local and spatially periodic activity patterns of a few discrete periods. Why has the mammalian lineage learnt this peculiar grid representation? Mathematical analysis suggests that this multi-periodic representation has excellent properties as an algebraic code with high capacity and intrinsic error-correction, but to date, there is no satisfactory synthesis of core principles that lead to multi-modular grid cells in deep recurrent neural networks. In this work, we begin by identifying key insights from four families of approaches to answering the grid cell question: coding theory, dynamical systems, function optimization and supervised deep learning. We then leverage our insights to propose a new approach that combines the strengths of all four approaches. Our approach is a self-supervised learning (SSL) framework - including data, data augmentations, loss functions and a network architecture - motivated from a normative perspective, without access to supervised position information or engineering of particular readout representations as needed in previous approaches. We show that multiple grid cell modules can emerge in networks trained on our SSL framework and that the networks and emergent representations generalize well outside their training distribution. This work contains insights for neuroscientists interested in the origins of grid cells as well as machine learning researchers interested in novel SSL frameworks.


title: Evaluating Machine Learning Classifier Approaches, and their Accuracy for the Detection of Cyberattacks on 5G IoT Systems

abstract: As 5G continues to expand its coverage and use. Innovative ideas/technologies continue to be implemented within. New vulnerabilities appear, thus resulting in new methods of mitigation and detection to occur. With the architecture that 5G can implement, DDoS (Distributed Denial of Service) is at a higher risk. There are many methods and approaches to help combat this challenge, most of which are implemented in networks containing Wi-Fi (Wireless Fidelity). This article aims to discuss the possible approaches that could be included in 5G technology. The method we will discuss involves Machine Learning. We have used three classifiers to test on datasets (Na\"ive Bayes, UltraBoost, LogitBoost) with multiple cross-folds, verifying which would have the highest accuracy with multiple factors (such as the cross-folds, verifying whether the number of folds affects accuracy), expanding upon [25] by using feature selection to obtain more accurate results.


title: The connecting homomorphism for Hermitian $K$-theory

abstract: We provide a geometric interpretation for the connecting homomorphism in the localization sequence of Hermitian $K$-theory. As an application, we compute the Hermitian $K$-theory of projective bundles and Grassmannians in the regular case. We provide an explicit basis for Hermitian $K$-theory of Grassmannians, which is indexed by even Young diagrams together with another special class of Young diagrams, that we call $\textit{buffalo-check}$ Young diagrams. To achieve this, we develop pushforwards and pullbacks in Hermitian $K$-theory using Grothendieck's residue complexes, and we establish fundamental theorems for those pushforwards and pullbacks, including base change, projection, and excess intersection formulas.


title: On the Robustness, Connectivity and Giant Component Size of Random K-out Graphs

abstract: Random K-out graphs are garnering interest in designing distributed systems including secure sensor networks, anonymous crypto-currency networks, and differentially-private decentralized learning. In these security-critical applications, it is important to model and analyze the resilience of the network to node failures and adversarial captures. Motivated by this, we analyze how the connectivity properties of random K-out graphs vary with the network parameters $K$, the number of nodes ($n$), and the number of nodes that get failed or compromised ($\gamma_n$). In particular, we study the conditions for achieving \emph{connectivity} {with high probability} and for the existence of a \emph{giant component} with formal guarantees on the size of the largest connected component in terms of the parameters $n,~K$, and $\gamma_n$. Next, we analyze the property of \emph{$r$-robustness} which is a stronger property than connectivity and leads to resilient consensus in the presence of malicious nodes. We derive conditions on $K$ and $n$ under which the random K-out graph achieves r-robustness with high probability. We also provide extensive numerical simulations and compare our results on random K-out graphs with known results on Erd\H{o}s-R\'enyi (ER) graphs.


title: The Hubble Diagram: Jump from Supernovae to Gamma-Ray Bursts

abstract: The Hubble diagram (HD) is a plot that contains luminous distance modulus presented with respect to the redshift. The distance modulus--redshift relation of the most well-known ``standard candles'', the type Ia supernovae (SN), is a crucial tool in cosmological model testing. In this work, we use the SN Ia data from the Pantheon catalogue to calibrate the Swift long gamma-ray bursts (LGRBs) as ``standard candles'' via the Amati relation. Thus, we expand the HD from supernovae to the area of the Swift LGRBs up to $z\sim8$. To improve the quality of estimation of the parameters and their errors, we implement the Monte-Carlo uncertainty propagation method. We also compare the results of estimation of the Amati parameters calibrated by the SN Ia, and by the standard $\Lambda$CDM model and find no statistically significant distinguish between them. Although the size of our LGRB sample is relatively small and the errors are high, we find this approach of expanding the cosmological distance scale perspective for future cosmological tests.


title: Identifying Context-Dependent Translations for Evaluation Set Production

abstract: A major impediment to the transition to context-aware machine translation is the absence of good evaluation metrics and test sets. Sentences that require context to be translated correctly are rare in test sets, reducing the utility of standard corpus-level metrics such as COMET or BLEU. On the other hand, datasets that annotate such sentences are also rare, small in scale, and available for only a few languages. To address this, we modernize, generalize, and extend previous annotation pipelines to produce CTXPRO, a tool that identifies subsets of parallel documents containing sentences that require context to correctly translate five phenomena: gender, formality, and animacy for pronouns, verb phrase ellipsis, and ambiguous noun inflections. The input to the pipeline is a set of hand-crafted, per-language, linguistically-informed rules that select contextual sentence pairs using coreference, part-of-speech, and morphological features provided by state-of-the-art tools. We apply this pipeline to seven languages pairs (EN into and out-of DE, ES, FR, IT, PL, PT, and RU) and two datasets (OpenSubtitles and WMT test sets), and validate its performance using both overlap with previous work and its ability to discriminate a contextual MT system from a sentence-based one. We release the CTXPRO pipeline and data as open source.


title: Adding highly undefinable sets over $L$

abstract: We sow that there exists a generic extension of the G\"{o}del's constructible universe in which diamond holds and there exists a subset $Y \subseteq \omega_1$ such that for stationary many $\delta < \omega_1,$ the set $Y \cap \delta$ is not definable in the structure $(L_{F(\delta)}, \in)$, where $F(\delta) > \delta$ is the least ordinal such that $L_{F(\delta)}\models$``$\delta$ is countable''.


title: The Metron Project -- I. The Metron Project Science Program

abstract: In this paper, the first in a series of four articles, the scientific goals of the Metron project are highlighted, and the characteristics of the cosmic objects available for study within its framework are provided. The Metron interferometer radio telescope should include arrays of meter-range dipole antennas placed on Earth, in outer space or on the far side of the Moon (or a combination of these options). Working in the meter range will enable the study of the so-called cosmological epoch of ``Dark Ages'', which is challenging to observe but highly interesting for understanding the origin of the first stars, galaxies, and black holes, as well as for the search for new cosmological objects and processes. One possibility is to search for absorption in the 21 cm line within extended halos around early protogalaxies and supermassive primordial black holes, whose existence is predicted in a number of models. Another goal of Metron may be to clarify the anomalous absorption in the 21 cm line previously detected by the EDGES telescopes and to observe radio emissions from stars' and exoplanets' magnetospheres. The Metron project aims to achieve unprecedented resolution for the meter range, which is expected to yield new world-class scientific results. Meter-range antennas and receivers are relatively simple and inexpensive, and the construction of interferometric arrays from them can be accomplished in a relatively short period of time.


title: Bounded and Unbiased Composite Differential Privacy

abstract: The objective of differential privacy (DP) is to protect privacy by producing an output distribution that is indistinguishable between any two neighboring databases. However, traditional differentially private mechanisms tend to produce unbounded outputs in order to achieve maximum disturbance range, which is not always in line with real-world applications. Existing solutions attempt to address this issue by employing post-processing or truncation techniques to restrict the output results, but at the cost of introducing bias issues. In this paper, we propose a novel differentially private mechanism which uses a composite probability density function to generate bounded and unbiased outputs for any numerical input data. The composition consists of an activation function and a base function, providing users with the flexibility to define the functions according to the DP constraints. We also develop an optimization algorithm that enables the iterative search for the optimal hyper-parameter setting without the need for repeated experiments, which prevents additional privacy overhead. Furthermore, we evaluate the utility of the proposed mechanism by assessing the variance of the composite probability density function and introducing two alternative metrics that are simpler to compute than variance estimation. Our extensive evaluation on three benchmark datasets demonstrates consistent and significant improvement over the traditional Laplace and Gaussian mechanisms. The proposed bounded and unbiased composite differentially private mechanism will underpin the broader DP arsenal and foster future privacy-preserving studies.


title: Lebesgue Property and $G$-completeness in Generalized Quasi-uniform Spaces

abstract: This paper extends the Lebesgue property and (weak) $G$-completeness to generalized quasi-uniform spaces. It investigates the connections between completeness, (weak) $G$-completeness, and the Lebesgue property of the product of generalized quasi-uniform spaces with those of the component spaces. It has been observed that the related behaviors differ for the Lebesgue property in contrast to completeness and (weak) $G$-completeness.


title: FragXsiteDTI: Revealing Responsible Segments in Drug-Target Interaction with Transformer-Driven Interpretation

abstract: Drug-Target Interaction (DTI) prediction is vital for drug discovery, yet challenges persist in achieving model interpretability and optimizing performance. We propose a novel transformer-based model, FragXsiteDTI, that aims to address these challenges in DTI prediction. Notably, FragXsiteDTI is the first DTI model to simultaneously leverage drug molecule fragments and protein pockets. Our information-rich representations for both proteins and drugs offer a detailed perspective on their interaction. Inspired by the Perceiver IO framework, our model features a learnable latent array, initially interacting with protein binding site embeddings using cross-attention and later refined through self-attention and used as a query to the drug fragments in the drug's cross-attention transformer block. This learnable query array serves as a mediator and enables seamless information translation, preserving critical nuances in drug-protein interactions. Our computational results on three benchmarking datasets demonstrate the superior predictive power of our model over several state-of-the-art models. We also show the interpretability of our model in terms of the critical components of both target proteins and drug molecules within drug-target pairs.


title: ECMD: An Event-Centric Multisensory Driving Dataset for SLAM

abstract: Leveraging multiple sensors enhances complex environmental perception and increases resilience to varying luminance conditions and high-speed motion patterns, achieving precise localization and mapping. This paper proposes, ECMD, an event-centric multisensory dataset containing 81 sequences and covering over 200 km of various challenging driving scenarios including high-speed motion, repetitive scenarios, dynamic objects, etc. ECMD provides data from two sets of stereo event cameras with different resolutions (640*480, 346*260), stereo industrial cameras, an infrared camera, a top-installed mechanical LiDAR with two slanted LiDARs, two consumer-level GNSS receivers, and an onboard IMU. Meanwhile, the ground-truth of the vehicle was obtained using a centimeter-level high-accuracy GNSS-RTK/INS navigation system. All sensors are well-calibrated and temporally synchronized at the hardware level, with recording data simultaneously. We additionally evaluate several state-of-the-art SLAM algorithms for benchmarking visual and LiDAR SLAM and identifying their limitations. The dataset is available at https://arclab-hku.github.io/ecmd/.


title: An Operator Learning Framework for Spatiotemporal Super-resolution of Scientific Simulations

abstract: In numerous contexts, high-resolution solutions to partial differential equations are required to capture faithfully essential dynamics which occur at small spatiotemporal scales, but these solutions can be very difficult and slow to obtain using traditional methods due to limited computational resources. A recent direction to circumvent these computational limitations is to use machine learning techniques for super-resolution, to reconstruct high-resolution numerical solutions from low-resolution simulations which can be obtained more efficiently. The proposed approach, the Super Resolution Operator Network (SROpNet), frames super-resolution as an operator learning problem and draws inspiration from existing architectures to learn continuous representations of solutions to parametric differential equations from low-resolution approximations, which can then be evaluated at any desired location. In addition, no restrictions are imposed on the locations of (the fixed number of) spatiotemporal sensors at which the low-resolution approximations are provided, thereby enabling the consideration of a broader spectrum of problems arising in practice, for which many existing super-resolution approaches are not well-suited.


title: Complex Organ Mask Guided Radiology Report Generation

abstract: The goal of automatic report generation is to generate a clinically accurate and coherent phrase from a single given X-ray image, which could alleviate the workload of traditional radiology reporting. However, in a real-world scenario, radiologists frequently face the challenge of producing extensive reports derived from numerous medical images, thereby medical report generation from multi-image perspective is needed. In this paper, we propose the Complex Organ Mask Guided (termed as COMG) report generation model, which incorporates masks from multiple organs (e.g., bones, lungs, heart, and mediastinum), to provide more detailed information and guide the model's attention to these crucial body regions. Specifically, we leverage prior knowledge of the disease corresponding to each organ in the fusion process to enhance the disease identification phase during the report generation process. Additionally, cosine similarity loss is introduced as target function to ensure the convergence of cross-modal consistency and facilitate model optimization.Experimental results on two public datasets show that COMG achieves a 11.4% and 9.7% improvement in terms of BLEU@4 scores over the SOTA model KiUT on IU-Xray and MIMIC, respectively. The code is publicly available at https://github.com/GaryGuTC/COMG_model.


title: Jet mixing enhancement with Bayesian optimization, deep learning, and persistent data topology

abstract: We optimize the jet mixing using large eddy simulations (LES) at a Reynolds number of $3000$. Key methodological enablers consist of Bayesian optimization, a surrogate model enhanced by deep learning, and persistent data topology for physical interpretation. The mixing performance is characterized by an equivalent jet radius ($R_{\rm eq}$) derived from the streamwise velocity in a plane located $8$ diameters downstream. The optimization is performed in a 22-dimensional actuation space that comprises most known excitations. The plant benefits from a 22-dimensional actuation space that comprises most known excitations. This search space parameterizes distributed actuation imposed on the bulk flow and at the periphery of the nozzle in the streamwise and radial directions. The momentum flux measures the energy input of the actuation. The optimization quadruples the jet radius $R_{\rm eq}$ with a $7$-armed blooming jet after around $570$ evaluations. The control input requires $2\%$ momentum flux of the main flow, which is one order of magnitude lower than an ad hoc dual-mode excitation. Intriguingly, a pronounced suboptimum in the search space is associated with a double-helix jet, a new flow pattern. This jet pattern results in a mixing improvement comparable to the blooming jet. A state-of-the-art Bayesian optimization converges towards this double helix solution. The learning is accelerated and converges to another better optimum by including surrogate model trained along the optimization. Persistent data topology extracts the global and many local minima in the actuation space. These minima can be identified with flow patterns beneficial to the mixing.


title: NODLINK: An Online System for Fine-Grained APT Attack Detection and Investigation

abstract: Advanced Persistent Threats (APT) attacks have plagued modern enterprises, causing significant financial losses. To counter these attacks, researchers propose techniques that capture the complex and stealthy scenarios of APT attacks by using provenance graphs to model system entities and their dependencies. Particularly, to accelerate attack detection and reduce financial losses, online provenance-based detection systems that detect and investigate APT attacks under the constraints of timeliness and limited resources are in dire need. Unfortunately, existing online systems usually sacrifice detection granularity to reduce computational complexity and produce provenance graphs with more than 100,000 nodes, posing challenges for security admins to interpret the detection results. In this paper, we design and implement NodLink, the first online detection system that maintains high detection accuracy without sacrificing detection granularity. Our insight is that the APT attack detection process in online provenance-based detection systems can be modeled as a Steiner Tree Problem (STP), which has efficient online approximation algorithms that recover concise attack-related provenance graphs with a theoretically bounded error. To utilize STP approximation algorithm frameworks for APT attack detection, we propose a novel design of in-memory cache, an efficient attack screening method, and a new STP approximation algorithm that is more efficient than the conventional one in APT attack detection while maintaining the same complexity. We evaluate NodLink in a production environment. The open-world experiment shows that NodLink outperforms two state-of-the-art (SOTA) online provenance analysis systems by achieving magnitudes higher detection and investigation accuracy while having the same or higher throughput.


title: Multimodal Machine Learning in Image-Based and Clinical Biomedicine: Survey and Prospects

abstract: Machine learning (ML) applications in medical artificial intelligence (AI) systems have shifted from traditional and statistical methods to increasing application of deep learning models. This survey navigates the current landscape of multimodal ML, focusing on its profound impact on medical image analysis and clinical decision support systems. Emphasizing challenges and innovations in addressing multimodal representation, fusion, translation, alignment, and co-learning, the paper explores the transformative potential of multimodal models for clinical predictions. It also highlights the need for principled assessments and practical implementation of such models, bringing attention to the dynamics between decision support systems and healthcare providers and personnel. Despite advancements, challenges such as data biases and the scarcity of "big data" in many biomedical domains persist. We conclude with a discussion on principled innovation and collaborative efforts to further the mission of seamless integration of multimodal ML models into biomedical practice.


title: Understanding the Natural Language of DNA using Encoder-Decoder Foundation Models with Byte-level Precision

abstract: This paper presents the Ensemble Nucleotide Byte-level Encoder-Decoder (ENBED) foundation model, analyzing DNA sequences at byte-level precision with an encoder-decoder Transformer architecture. ENBED uses a sub-quadratic implementation of attention to develop an efficient model capable of sequence-to-sequence transformations, generalizing previous genomic models with encoder-only or decoder-only architectures. We use Masked Language Modeling to pre-train the foundation model using reference genome sequences and apply it in the following downstream tasks: (1) identification of enhancers, promotors and splice sites, (2) recognition of sequences containing base call mismatches and insertion/deletion errors, an advantage over tokenization schemes involving multiple base pairs, which lose the ability to analyze with byte-level precision, (3) identification of biological function annotations of genomic sequences, and (4) generating mutations of the Influenza virus using the encoder-decoder architecture and validating them against real-world observations. In each of these tasks, we demonstrate significant improvement as compared to the existing state-of-the-art results.


title: Asymptotic analysis for Bloch electrons with Weyl nodes

abstract: In this paper, we study the semiclassical behavior of Bloch electrons in the presence of Weyl nodes, which are singular points in the band structure of certain materials. We carry out asymptotic analysis and present a rigorous derivation of the semiclassical asymptotic expansion of the current of Bloch electrons with the presence of Weyl nodes. The analysis shows that the current contains two parts, one independent of the Weyl nodes and the other a contribution from the singular points. This work provides a theoretical foundation towards a rigorous justification of recent scientific discoveries in Weyl semimetals. The main innovation of this paper is a new strategy to deal with the singular points with quantitative estimates, which may have broader applications in multiscale models with singularities.


title: Machine learning approach to analyze heavy quark diffusion coefficient in relativistic heavy-ion collisions

abstract: The diffusion coefficient of heavy quarks in the deconfined medium is examined in this research using a deep convolutional neural network (CNN) trained with data from relativistic heavy ion collisions involving heavy flavor hadrons. The CNN is trained using observables such as the nuclear modification factor $R_{AA}$ and the elliptic flow $v_2$ of non-prompt $J/\psi$ from B-hadron decay in different centralities, where B meson evolutions are calculated using the Langevin equation and the Instantaneous Coalescence Model. The CNN outputs the parameters characterizing the temperature and momentum dependence of the heavy quark diffusion coefficient. By inputting the experimental data of non-prompt $J/\psi$ $(R_{AA}, v_2)$ from various collision centralities into multiple channels of the well-trained network, we derive the values of the diffusion coefficient parameters. Additionally, We evaluate the uncertainty in determining the diffusion coefficient by taking into account the uncertainties present in the experimental data $(R_{AA}, v_2)$, which serve as inputs to the deep neural network.


title: Green light GaN p-n junction luminescent particles enhance the superconducting properties of B(P)SCCO Smart Meta-Superconductors (SMSCs)

abstract: Superconducting materials exhibit unique physical properties and hold great scientific value and vast industrial application prospects. However, due to limitations such as critical temperature (TC) and critical current density (JC), the large-scale application of superconducting materials remains challenging. Chemical doping has been a commonly used method to enhance the superconductivity of B(P)SCCO. However, satisfactory enhancement results have been difficult to achieve. In this study, we introduced green light GaN p-n junction particles as inhomogeneous phases into B(P)SCCO polycrystalline particles to form a smart meta-superconductors (SMSCs) structure. Based on the electroluminescence properties of the p-n junction, the Cooper pairs were stimulated and strengthened to enhance the superconductivity of B(P)SCCO. Experimental results demonstrate that the introduction of inhomogeneous phases can indeed enhance the critical temperature TC, critical current density JC, and complete diamagnetism (Meissner effect) of B(P)SCCO superconductors. Moreover, When the particle size of raw material of B(P)SCCO is reduced from 30{\mu}m to 5{\mu}m, the grain size of the sintered samples also decreases, and the optimal doping concentration of the inhomogeneous phases increases from 0.15 wt.% to 0.2 wt.%, further improving the enhancement of superconductivity.


title: STOW: Discrete-Frame Segmentation and Tracking of Unseen Objects for Warehouse Picking Robots

abstract: Segmentation and tracking of unseen object instances in discrete frames pose a significant challenge in dynamic industrial robotic contexts, such as distribution warehouses. Here, robots must handle object rearrangement, including shifting, removal, and partial occlusion by new items, and track these items after substantial temporal gaps. The task is further complicated when robots encounter objects not learned in their training sets, which requires the ability to segment and track previously unseen items. Considering that continuous observation is often inaccessible in such settings, our task involves working with a discrete set of frames separated by indefinite periods during which substantial changes to the scene may occur. This task also translates to domestic robotic applications, such as rearrangement of objects on a table. To address these demanding challenges, we introduce new synthetic and real-world datasets that replicate these industrial and household scenarios. We also propose a novel paradigm for joint segmentation and tracking in discrete frames along with a transformer module that facilitates efficient inter-frame communication. The experiments we conduct show that our approach significantly outperforms recent methods. For additional results and videos, please visit \href{https://sites.google.com/view/stow-corl23}{website}. Code and dataset will be released.


title: Potato Leaf Disease Classification using Deep Learning: A Convolutional Neural Network Approach

abstract: In this study, a Convolutional Neural Network (CNN) is used to classify potato leaf illnesses using Deep Learning. The suggested approach entails preprocessing the leaf image data, training a CNN model on that data, and assessing the model's success on a test set. The experimental findings show that the CNN model, with an overall accuracy of 99.1%, is highly accurate in identifying two kinds of potato leaf diseases, including Early Blight, Late Blight, and Healthy. The suggested method may offer a trustworthy and effective remedy for identifying potato diseases, which is essential for maintaining food security and minimizing financial losses in agriculture. The model can accurately recognize the various disease types even when there are severe infections present. This work highlights the potential of deep learning methods for categorizing potato diseases, which can help with effective and automated disease management in potato farming.


title: Progress Metrics in DAG-based Consensus

abstract: Lachesis protocol~\cite{lachesis2021} leverages a DAG of events to allow nodes to reach fast consensus of events. This work introduces DAG progress metrics to drive the nodes to emit new events more effectively. With these metrics, nodes can select event timing and can choose previous events as parents for their own new events. Our results show that our event timing and parent selection methods can help reaching consensus quicker and thus can reduce lower time to finality significantly.


title: MC-Stereo: Multi-peak Lookup and Cascade Search Range for Stereo Matching

abstract: Stereo matching is a fundamental task in scene comprehension. In recent years, the method based on iterative optimization has shown promise in stereo matching. However, the current iteration framework employs a single-peak lookup, which struggles to handle the multi-peak problem effectively. Additionally, the fixed search range used during the iteration process limits the final convergence effects. To address these issues, we present a novel iterative optimization architecture called MC-Stereo. This architecture mitigates the multi-peak distribution problem in matching through the multi-peak lookup strategy, and integrates the coarse-to-fine concept into the iterative framework via the cascade search range. Furthermore, given that feature representation learning is crucial for successful learn-based stereo matching, we introduce a pre-trained network to serve as the feature extractor, enhancing the front end of the stereo matching pipeline. Based on these improvements, MC-Stereo ranks first among all publicly available methods on the KITTI-2012 and KITTI-2015 benchmarks, and also achieves state-of-the-art performance on ETH3D. Code is available at https://github.com/MiaoJieF/MC-Stereo.


title: Enhancing English Writing Proficiency in China's Polytechnic Students An In-Depth Literature Review on the Application of the Input Hypothesis

abstract: Having good English writing skills is extremely important for students in polytechnic institutions. However, a lot of students in technical schools have difficulties in reaching high levels of skill. The Input Hypothesis, created by Stephen Krashen, suggests that people learn languages well when they receive information that's a little harder than what they already know but still understandable. This research paper wants to study how the Input Hypothesis can help polytechnic students improve their English writing skills. The study will include real-life observations and experiments from the previous research. We will look at data from polytechnic students who are receiving special writing instruction to see if the Input Hypothesis actually helps improve their writing skills. The paper can better inform polytechnic students, faculty members, and support staff and even members of the larger community about the attributions, the processes, and the possible outcomes of second language development for polytechnic students. Keywords: English writing skills, Polytechnic students, Input hypothesis, Comprehensible input


title: Proposal-Level Unsupervised Domain Adaptation for Open World Unbiased Detector

abstract: Open World Object Detection (OWOD) combines open-set object detection with incremental learning capabilities to handle the challenge of the open and dynamic visual world. Existing works assume that a foreground predictor trained on the seen categories can be directly transferred to identify the unseen categories' locations by selecting the top-k most confident foreground predictions. However, the assumption is hardly valid in practice. This is because the predictor is inevitably biased to the known categories, and fails under the shift in the appearance of the unseen categories. In this work, we aim to build an unbiased foreground predictor by re-formulating the task under Unsupervised Domain Adaptation, where the current biased predictor helps form the domains: the seen object locations and confident background locations as the source domain, and the rest ambiguous ones as the target domain. Then, we adopt the simple and effective self-training method to learn a predictor based on the domain-invariant foreground features, hence achieving unbiased prediction robust to the shift in appearance between the seen and unseen categories. Our approach's pipeline can adapt to various detection frameworks and UDA methods, empirically validated by OWOD evaluation, where we achieve state-of-the-art performance.


title: Stable Diffusion Reference Only: Image Prompt and Blueprint Jointly Guided Multi-Condition Diffusion Model for Secondary Painting

abstract: Stable Diffusion and ControlNet have achieved excellent results in the field of image generation and synthesis. However, due to the granularity and method of its control, the efficiency improvement is limited for professional artistic creations such as comics and animation production whose main work is secondary painting. In the current workflow, fixing characters and image styles often need lengthy text prompts, and even requires further training through TextualInversion, DreamBooth or other methods, which is very complicated and expensive for painters. Therefore, we present a new method in this paper, Stable Diffusion Reference Only, a images-to-image self-supervised model that uses only two types of conditional images for precise control generation to accelerate secondary painting. The first type of conditional image serves as an image prompt, supplying the necessary conceptual and color information for generation. The second type is blueprint image, which controls the visual structure of the generated image. It is natively embedded into the original UNet, eliminating the need for ControlNet. We released all the code for the module and pipeline, and trained a controllable character line art coloring model at https://github.com/aihao2000/stable-diffusion-reference-only, that achieved state-of-the-art results in this field. This verifies the effectiveness of the structure and greatly improves the production efficiency of animations, comics, and fanworks.


title: You Only Forward Once: Prediction and Rationalization in A Single Forward Pass

abstract: Unsupervised rationale extraction aims to extract concise and contiguous text snippets to support model predictions without any annotated rationale. Previous studies have used a two-phase framework known as the Rationalizing Neural Prediction (RNP) framework, which follows a generate-then-predict paradigm. They assumed that the extracted explanation, called rationale, should be sufficient to predict the golden label. However, the assumption above deviates from the original definition and is too strict to perform well. Furthermore, these two-phase models suffer from the interlocking problem and spurious correlations. To solve the above problems, we propose a novel single-phase framework called You Only Forward Once (YOFO), derived from a relaxed version of rationale where rationales aim to support model predictions rather than make predictions. In our framework, A pre-trained language model like BERT is deployed to simultaneously perform prediction and rationalization with less impact from interlocking or spurious correlations. Directly choosing the important tokens in an unsupervised manner is intractable. Instead of directly choosing the important tokens, YOFO gradually removes unimportant tokens during forward propagation. Through experiments on the BeerAdvocate and Hotel Review datasets, we demonstrate that our model is able to extract rationales and make predictions more accurately compared to RNP-based models. We observe an improvement of up to 18.4\% in token-level F1 compared to previous state-of-the-art methods. We also conducted analyses and experiments to explore the extracted rationales and token decay strategies. The results show that YOFO can extract precise and important rationales while removing unimportant tokens in the middle part of the model.


title: Perturbation-based Active Learning for Question Answering

abstract: Building a question answering (QA) model with less annotation costs can be achieved by utilizing active learning (AL) training strategy. It selects the most informative unlabeled training data to update the model effectively. Acquisition functions for AL are used to determine how informative each training example is, such as uncertainty or diversity based sampling. In this work, we propose a perturbation-based active learning acquisition strategy and demonstrate it is more effective than existing commonly used strategies.