title: Multi-Affiliated Authors Behave Differently across Fields and Host Country Preferences: A Comparison in G7 and BRICS

abstract: This paper study author simultaneously engaged in multiple affiliations based on bibliometric data covered in the Web of Science for the 2017-2021 period. Based on the affiliation information in publication records, we propose a general classification for multiple affiliations within-country or cross-country for analyzing authors' behavior in multiple affiliations and preferences of host countries across research fields. We find a decrease in publications led by international multi-affiliated authorship after 2020, and China has shown a falling trend after 2018. More G7 countries are active in fields like Social Sciences, Clinical and Life Sciences. China, India, and Russia are active in physical sciences-related fields. Countries prefer to affiliate with G7 countries, especially in Clinical and Life Sciences. These findings may provide more insights into the understanding of the behavior and productivity of multi-affiliated researchers in the current academic landscape.


title: Are You Worthy of My Trust?: A Socioethical Perspective on the Impacts of Trustworthy AI Systems on the Environment and Human Society

abstract: With ubiquitous exposure of AI systems today, we believe AI development requires crucial considerations to be deemed trustworthy. While the potential of AI systems is bountiful, though, is still unknown-as are their risks. In this work, we offer a brief, high-level overview of societal impacts of AI systems. To do so, we highlight the requirement of multi-disciplinary governance and convergence throughout its lifecycle via critical systemic examinations (e.g., energy consumption), and later discuss induced effects on the environment (i.e., carbon footprint) and its users (i.e., social development). In particular, we consider these impacts from a multi-disciplinary perspective: computer science, sociology, environmental science, and so on to discuss its inter-connected societal risks and inability to simultaneously satisfy aspects of well-being. Therefore, we accentuate the necessity of holistically addressing pressing concerns of AI systems from a socioethical impact assessment perspective to explicate its harmful societal effects to truly enable humanity-centered Trustworthy AI.


title: Fitchean Ignorance and First-order Ignorance: A Neighborhood Look

abstract: In a seminal work~\cite{Fine:2018}, Fine classifies several forms of ignorance, among which are Fitchean ignorance, first-order ignorance, Rumsfeld ignorance, and second-order ignorance. It is shown that there is interesting relationship among some of them, which includes that in ${\bf S4}$, all higher-order ignorance are reduced to second-order ignorance. This is thought of as a bad consequence by some researchers. It is then natural to ask how to avoid this consequence. We deal with this issue in a much more general framework. In detail, we treat the forms of Fitchean ignorance and first-order ignorance as primitive modalities and study them as first-class citizens under neighborhood semantics, in which Rumsfeld ignorance and second-order ignorance are definable. The main contributions include model-theoretical results such as expressivity and frame definability, and axiomatizations. Last but not least, by updating the neighborhood models via the intersection semantics, we extend the results to the dynamic case of public announcements, which gives us some applications to successful formulas.


title: Beyond expected values: Making environmental decisions using value of information analysis when measurement outcome matters

abstract: In ecological and environmental contexts, management actions must sometimes be chosen urgently. Value of information (VoI) analysis provides a quantitative toolkit for projecting the improved management outcomes expected after making additional measurements. However, traditional VoI analysis reports metrics as expected values (i.e. risk-neutral). This can be problematic because expected values hide uncertainties in projections. The true value of a measurement will only be known after the measurement's outcome is known, leaving large uncertainty in the measurement's value before it is performed. As a result, the expected value metrics produced in traditional VoI analysis may not align with the priorities of a risk-averse decision-maker who wants to avoid low-value measurement outcomes. In the present work, we introduce four new VoI metrics that can address a decision-maker's risk-aversion to different measurement outcomes. We demonstrate the benefits of the new metrics with two ecological case studies for which traditional VoI analysis has been previously applied. Using the new metrics, we also demonstrate a clear mathematical link between the often-separated environmental decision-making disciplines of VoI and optimal design of experiments. This mathematical link has the potential to catalyse future collaborations between ecologists and statisticians to work together to quantitatively address environmental decision-making questions of fundamental importance. Overall, the introduced VoI metrics complement existing metrics to provide decision-makers with a comprehensive view of the value of, and risks associated with, a proposed monitoring or measurement activity. This is critical for improved environmental outcomes when decisions must be urgently made.


title: The persistence of a tropical cyclone seed vortex depends on its structure

abstract: Tropical cyclones (TC) are often generated from pre-existing ``seed" vortices. Seeds with higher persistence might have a higher chance to undergo TC genesis. What controls seed persistence remains unclear. This study proposes that planetary Rossby wave drag is a key factor that affects seed persistence. Using recently developed theory for the response of a vortex to the planetary vorticity gradient, a new parameter given by the ratio of the maximum wind speed ($V_{max}$) to the Rhines speed at the radius of maximum wind ($R_{max}$), here termed ``vortex compactness" ($C_v$), is introduced to characterize the vortex weakening by planetary Rossby wave drag. The relationship between vortex compactness and weakening rate is tested via barotropic $\beta$-plane experiments. The vortex's initial $C_v$ is varied by systematically varying their initial $V_{max}$ and $R_{max}$ in idealized wind profile models. Experiments using vorticity distributions from real-world seeds possessing are also taken from reanalysis. The weakening rate depends strongly on the vortex's initial $C_v$ across both idealized and real-world experiments, and the asymmetry introduces minor differences. Experiments doubling the size of seed vortices cause them to weaken more rapidly in line with other experiment sets. The dependence of the weakening rate on initial compactness can be predicted from a simple theory, which is more robust for more compact vortices. Our results suggest that a seed's structure strongly modulates how long it can persist in the presence of a planetary vorticity gradient. Connections to real seeds on Earth are discussed.


title: Asymptotically Efficient Online Learning for Censored Regression Models Under Non-I.I.D Data

abstract: The asymptotically efficient online learning problem is investigated for stochastic censored regression models, which arise from various fields of learning and statistics but up to now still lacks comprehensive theoretical studies on the efficiency of the learning algorithms. For this, we propose a two-step online algorithm, where the first step focuses on achieving algorithm convergence, and the second step is dedicated to improving the estimation performance. Under a general excitation condition on the data, we show that our algorithm is strongly consistent and asymptotically normal by employing the stochastic Lyapunov function method and limit theories for martingales. Moreover, we show that the covariances of the estimates can achieve the Cramer-Rao (C-R) bound asymptotically, indicating that the performance of the proposed algorithm is the best possible that one can expect in general. Unlike most of the existing works, our results are obtained without resorting to the traditionally used but stringent conditions such as independent and identically distributed (i.i.d) assumption on the data, and thus our results do not exclude applications to stochastic dynamical systems with feedback. A numerical example is also provided to illustrate the superiority of the proposed online algorithm over the existing related ones in the literature.


title: CaT: Balanced Continual Graph Learning with Graph Condensation

abstract: Continual graph learning (CGL) is purposed to continuously update a graph model with graph data being fed in a streaming manner. Since the model easily forgets previously learned knowledge when training with new-coming data, the catastrophic forgetting problem has been the major focus in CGL. Recent replay-based methods intend to solve this problem by updating the model using both (1) the entire new-coming data and (2) a sampling-based memory bank that stores replayed graphs to approximate the distribution of historical data. After updating the model, a new replayed graph sampled from the incoming graph will be added to the existing memory bank. Despite these methods are intuitive and effective for the CGL, two issues are identified in this paper. Firstly, most sampling-based methods struggle to fully capture the historical distribution when the storage budget is tight. Secondly, a significant data imbalance exists in terms of the scales of the complex new-coming graph data and the lightweight memory bank, resulting in unbalanced training. To solve these issues, a Condense and Train (CaT) framework is proposed in this paper. Prior to each model update, the new-coming graph is condensed to a small yet informative synthesised replayed graph, which is then stored in a Condensed Graph Memory with historical replay graphs. In the continual learning phase, a Training in Memory scheme is used to update the model directly with the Condensed Graph Memory rather than the whole new-coming graph, which alleviates the data imbalance problem. Extensive experiments conducted on four benchmark datasets successfully demonstrate superior performances of the proposed CaT framework in terms of effectiveness and efficiency. The code has been released on https://github.com/superallen13/CaT-CGL.


title: Object2Scene: Putting Objects in Context for Open-Vocabulary 3D Detection

abstract: Point cloud-based open-vocabulary 3D object detection aims to detect 3D categories that do not have ground-truth annotations in the training set. It is extremely challenging because of the limited data and annotations (bounding boxes with class labels or text descriptions) of 3D scenes. Previous approaches leverage large-scale richly-annotated image datasets as a bridge between 3D and category semantics but require an extra alignment process between 2D images and 3D points, limiting the open-vocabulary ability of 3D detectors. Instead of leveraging 2D images, we propose Object2Scene, the first approach that leverages large-scale large-vocabulary 3D object datasets to augment existing 3D scene datasets for open-vocabulary 3D object detection. Object2Scene inserts objects from different sources into 3D scenes to enrich the vocabulary of 3D scene datasets and generates text descriptions for the newly inserted objects. We further introduce a framework that unifies 3D detection and visual grounding, named L3Det, and propose a cross-domain category-level contrastive learning approach to mitigate the domain gap between 3D objects from different datasets. Extensive experiments on existing open-vocabulary 3D object detection benchmarks show that Object2Scene obtains superior performance over existing methods. We further verify the effectiveness of Object2Scene on a new benchmark OV-ScanNet-200, by holding out all rare categories as novel categories not seen during training.


title: Exploring and Learning in Sparse Linear MDPs without Computationally Intractable Oracles

abstract: The key assumption underlying linear Markov Decision Processes (MDPs) is that the learner has access to a known feature map $\phi(x, a)$ that maps state-action pairs to $d$-dimensional vectors, and that the rewards and transitions are linear functions in this representation. But where do these features come from? In the absence of expert domain knowledge, a tempting strategy is to use the ``kitchen sink" approach and hope that the true features are included in a much larger set of potential features. In this paper we revisit linear MDPs from the perspective of feature selection. In a $k$-sparse linear MDP, there is an unknown subset $S \subset [d]$ of size $k$ containing all the relevant features, and the goal is to learn a near-optimal policy in only poly$(k,\log d)$ interactions with the environment. Our main result is the first polynomial-time algorithm for this problem. In contrast, earlier works either made prohibitively strong assumptions that obviated the need for exploration, or required solving computationally intractable optimization problems. Along the way we introduce the notion of an emulator: a succinct approximate representation of the transitions that suffices for computing certain Bellman backups. Since linear MDPs are a non-parametric model, it is not even obvious whether polynomial-sized emulators exist. We show that they do exist and can be computed efficiently via convex programming. As a corollary of our main result, we give an algorithm for learning a near-optimal policy in block MDPs whose decoding function is a low-depth decision tree; the algorithm runs in quasi-polynomial time and takes a polynomial number of samples. This can be seen as a reinforcement learning analogue of classic results in computational learning theory. Furthermore, it gives a natural model where improving the sample complexity via representation learning is computationally feasible.


title: Realizing chameleonlike thermal rotator with transformation-invariant metamaterials

abstract: Heat flux rotation has important significance in thermal protection since it can shield the heat energy from a selected direction. Combining with tailored metamaterials, transformation thermotics provides a powerful way to manipulate heat flux, and various kinds of thermal meta-devices have been designed including thermal rotator. However, the existing transformation-thermotics-based thermal rotator can only work in a fixed background. Remanufacturing is inevitable when background changes, which is inconvenient and restricts the practical application. Here, we propose a novel mechanism for chameleonlike thermal rotator. The designed rotator can adaptively change its thermal conductivity with the object nearby while rotating heat flux without distorting the background temperature profile, just like a chameleon in nature. Moreover, such rotator is made of transformation-invariant material, thus its constitutive parameters do not change under arbitrary coordinate transformations. Therefore, the proposed rotator also has functionality-invariance beyond shape adjustment, and can theoretically transfer heat flux in arbitrary direction using different shapes of the same material. A prototype rotator was designed and fabricated, and its chameleonlike behavior is successfully demonstrated. Our concept provides a guidance to design chameleonlike thermal meta-devices and can be extended to other fields like acoustics, hydrodynamics, etc. The chameleonlike thermal rotator will have potential applications for the implementation of adaptive and adjustable metamaterials.


title: Multipartite entanglement measures: a review

abstract: Quantum entanglement, a fundamental aspect of quantum mechanics, has captured significant attention in the era of quantum information science. In multipartite quantum systems, entanglement plays a crucial role in facilitating various quantum information processing tasks, such as quantum teleportation and dense coding. In this article, we review the theory of multipartite entanglement measures, with a particular focus on the genuine as well as the operational meaning of multipartite entanglement measures. By providing a thorough and valuable insight on this field, we hope that this review would inspire and guide researchers in their endeavors to further develop novel approaches for characterizing multipartite entanglement.


title: Multi-user passive beamforming in RIS-aided communications and experimental validations

abstract: Reconfigurable intelligent surface (RIS) is a promising technology for future wireless communications due to its capability of optimizing the propagation environments. Nevertheless, in literature, there are few prototypes serving multiple users. In this paper, we propose a whole flow of channel estimation and beamforming design for RIS, and set up an RIS-aided multi-user system for experimental validations. Specifically, we combine a channel sparsification step with generalized approximate message passing (GAMP) algorithm, and propose to generate the measurement matrix as Rademacher distribution to obtain the channel state information (CSI). To generate the reflection coefficients with the aim of maximizing the spectral efficiency, we propose a quadratic transform-based low-rank multi-user beamforming (QTLM) algorithm. Our proposed algorithms exploit the sparsity and low-rank properties of the channel, which has the advantages of light calculation and fast convergence. Based on the universal software radio peripheral devices, we built a complete testbed working at 5.8GHz and implemented all the proposed algorithms to verify the possibility of RIS assisting multi-user systems. Experimental results show that the system has obtained an average spectral efficiency increase of 13.48bps/Hz, with respective received power gains of 26.6dB and 17.5dB for two users, compared with the case when RIS is powered-off.


title: A remark on toric foliations

abstract: If a toric foliation on a projective Q-factorial toric variety has an extremal ray whose length is longer than the rank of the foliation, then the associated extremal contraction is a projective space bundle and the foliation is the relative tangent sheaf of the extremal contraction.


title: Theoretical analysis on the possibility of superconductivity in a trilayer Ruddlesden-Popper nickelate La$_4$Ni$_3$O$_{10}$ under pressure and its experimental examination: comparison with La$_3$Ni$_2$O$_7$

abstract: We study the possibility of superconductivity in a trilayer Ruddlesden-Popper nickelate La$_4$Ni$_3$O$_{10}$ under pressure both theoretically and experimentally, making comparison with the recently discovered high $T_c$ superconductor La$_3$Ni$_2$O$_7$, a bilayer nickelate. Through DFT calculations, we find that a structural phase transition from monoclinic to tetragonal takes place around 10 - 15 GPa. Using the tetragonal crystal structure, we theoretically investigate the possibility of superconductivity, where a combination of fluctuation exchange approximation and linearized Eliashberg equation is applied to a six-orbital model constructed from first principles band calculation. The obtained results suggests that La$_4$Ni$_3$O$_{10}$ may also become superconducting under high pressure with $T_c$ comparable to some cuprates, although it is not as high as La$_3$Ni$_2$O$_7$. We also perform experimental studies using our polycrystalline samples of La$_3$Ni$_2$O$_{7.01}$ and La$_4$Ni$_3$O$_{9.99}$. The superconducting transition of La$_3$Ni$_2$O$_{7.01}$, with a maximum onset $T_c$ of 67.0 K at a pressure of 26.5 GPa, is confirmed by a drop in the electrical resistance, as well as the magnetic field dependence of the resistance. Quite interestingly, similar temperature and magnetic field dependencies of the resistance are observed also for La$_4$Ni$_3$O$_{9.99}$, where a drop in the resistance is observed at lower temperatures compared to La$_3$Ni$_2$O$_{7.01}$, under pressures of 32.8 GPa and above. Given the theoretical expectation, the reduction in the resistance can most likely be attributed to the occurrence of superconductivity in La$_4$Ni$_3$O$_{9.99}$. The temperature at which the resistance deviates from a linear behavior, considered as the onset $T_c$, monotonically increases up to 23 K at 79.2 GPa, which is opposite to the pressure dependence of $T_c$ in La3Ni2O7.01.


title: Ab initio study of the structure and properties of amorphous silicon hydride from accelerated molecular dynamics simulations

abstract: This paper presents a large-scale $ab$ $initio$ simulation study of amorphous silicon hydride ($a$-Si$_{\text{1-x}}$H$_{\text{x}}$) with an emphasis on the structure and properties of the material across a range of hydrogen concentration by combining accelerated molecular dynamics (MD) simulations with first-principles density-functional calculations. The accelerated MD scheme relied on classical metadynamics, which enabled the development of 2600+ high-quality structural models of $a$-Si$_{\text{1-x}}$H$_{\text{x}}$, with system sizes ranging from 150 to 6,000 atoms and hydrogen concentrations vary from 6 to 20 at. %H. The resulting amorphous networks were found to be completely free from any coordination defects and that they all exhibited a pristine band-gap in their electronic spectrum. The microstructural properties of hydrogen distributions were examined with great emphasis on the presence of isolated and clustered environments of hydrogen atoms. The results were compared with a suite of experimental data obtained from x-ray diffraction, infrared spectroscopy, spectroscopic ellipsometry and nuclear magnetic resonance studies.


title: Reducing Adversarial Training Cost with Gradient Approximation

abstract: Deep learning models have achieved state-of-the-art performances in various domains, while they are vulnerable to the inputs with well-crafted but small perturbations, which are named after adversarial examples (AEs). Among many strategies to improve the model robustness against AEs, Projected Gradient Descent (PGD) based adversarial training is one of the most effective methods. Unfortunately, the prohibitive computational overhead of generating strong enough AEs, due to the maximization of the loss function, sometimes makes the regular PGD adversarial training impractical when using larger and more complicated models. In this paper, we propose that the adversarial loss can be approximated by the partial sum of Taylor series. Furthermore, we approximate the gradient of adversarial loss and propose a new and efficient adversarial training method, adversarial training with gradient approximation (GAAT), to reduce the cost of building up robust models. Additionally, extensive experiments demonstrate that this efficiency improvement can be achieved without any or with very little loss in accuracy on natural and adversarial examples, which show that our proposed method saves up to 60\% of the training time with comparable model test accuracy on MNIST, CIFAR-10 and CIFAR-100 datasets.


title: Active anomaly detection based on deep one-class classification

abstract: Active learning has been utilized as an efficient tool in building anomaly detection models by leveraging expert feedback. In an active learning framework, a model queries samples to be labeled by experts and re-trains the model with the labeled data samples. It unburdens in obtaining annotated datasets while improving anomaly detection performance. However, most of the existing studies focus on helping experts identify as many abnormal data samples as possible, which is a sub-optimal approach for one-class classification-based deep anomaly detection. In this paper, we tackle two essential problems of active learning for Deep SVDD: query strategy and semi-supervised learning method. First, rather than solely identifying anomalies, our query strategy selects uncertain samples according to an adaptive boundary. Second, we apply noise contrastive estimation in training a one-class classification model to incorporate both labeled normal and abnormal data effectively. We analyze that the proposed query strategy and semi-supervised loss individually improve an active learning process of anomaly detection and further improve when combined together on seven anomaly detection datasets.


title: Progressive Text-to-Image Diffusion with Soft Latent Direction

abstract: In spite of the rapidly evolving landscape of text-to-image generation, the synthesis and manipulation of multiple entities while adhering to specific relational constraints pose enduring challenges. This paper introduces an innovative progressive synthesis and editing operation that systematically incorporates entities into the target image, ensuring their adherence to spatial and relational constraints at each sequential step. Our key insight stems from the observation that while a pre-trained text-to-image diffusion model adeptly handles one or two entities, it often falters when dealing with a greater number. To address this limitation, we propose harnessing the capabilities of a Large Language Model (LLM) to decompose intricate and protracted text descriptions into coherent directives adhering to stringent formats. To facilitate the execution of directives involving distinct semantic operations-namely insertion, editing, and erasing-we formulate the Stimulus, Response, and Fusion (SRF) framework. Within this framework, latent regions are gently stimulated in alignment with each operation, followed by the fusion of the responsive latent components to achieve cohesive entity manipulation. Our proposed framework yields notable advancements in object synthesis, particularly when confronted with intricate and lengthy textual inputs. Consequently, it establishes a new benchmark for text-to-image generation tasks, further elevating the field's performance standards.


title: A model of stochastic memoization and name generation in probabilistic programming: categorical semantics via monads on presheaf categories

abstract: Stochastic memoization is a higher-order construct of probabilistic programming languages that is key in Bayesian nonparametrics, a modular approach that allows us to extend models beyond their parametric limitations and compose them in an elegant and principled manner. Stochastic memoization is simple and useful in practice, but semantically elusive, particularly regarding dataflow transformations. As the naive implementation resorts to the state monad, which is not commutative, it is not clear if stochastic memoization preserves the dataflow property -- i.e., whether we can reorder the lines of a program without changing its semantics, provided the dataflow graph is preserved. In this paper, we give an operational and categorical semantics to stochastic memoization and name generation in the context of a minimal probabilistic programming language, for a restricted class of functions. Our contribution is a first model of stochastic memoization of constant Bernoulli functions with a non-enumerable type, which validates data flow transformations, bridging the gap between traditional probability theory and higher-order probability models. Our model uses a presheaf category and a novel probability monad on it.


title: Thermodynamics of imbibition in capillaries of double conical structures-Hourglass, diamond, and sawtooth shaped capillaries-

abstract: Thermodynamics of imbibition (intrusion and extrusion) in capillaries of double conical structures is theoretically studied using the classical capillary model. By extending the knowledge of the thermodynamics of a single conical capillary, not only the nature of spontaneous imbibition but that of forced imbibition under applied external pressure are clarified. Spontaneous imbibition in capillaries of double conical structure can be predicted from the Laplace pressure in a single conical capillary. To understand the forced imbibition process, the free energy landscape along the imbibition pathway is calculated. This landscape shows either a maximum or a minimum. The former acts as the energy barrier and the latter acts as the trap for the liquid-vapor meniscus so that the imbibition process can be either abrupt with a pressure hysteresis or gradual and continuous. The landscape also predicts a completely filled, a half-filled and a completely empty state as the thermodynamically stable state. Furthermore, it also predicts a completely filled and a half-filled state of metastable liquid which can be prepared by the combination of the intrusion and the extrusion process. Our study could be useful for understanding various natural fluidic systems and for designing functional fluidic devices such as a diode, a switch etc.


title: Spiking-LEAF: A Learnable Auditory front-end for Spiking Neural Networks

abstract: Brain-inspired spiking neural networks (SNNs) have demonstrated great potential for temporal signal processing. However, their performance in speech processing remains limited due to the lack of an effective auditory front-end. To address this limitation, we introduce Spiking-LEAF, a learnable auditory front-end meticulously designed for SNN-based speech processing. Spiking-LEAF combines a learnable filter bank with a novel two-compartment spiking neuron model called IHC-LIF. The IHC-LIF neurons draw inspiration from the structure of inner hair cells (IHC) and they leverage segregated dendritic and somatic compartments to effectively capture multi-scale temporal dynamics of speech signals. Additionally, the IHC-LIF neurons incorporate the lateral feedback mechanism along with spike regularization loss to enhance spike encoding efficiency. On keyword spotting and speaker identification tasks, the proposed Spiking-LEAF outperforms both SOTA spiking auditory front-ends and conventional real-valued acoustic features in terms of classification accuracy, noise robustness, and encoding efficiency.


title: Face-Driven Zero-Shot Voice Conversion with Memory-based Face-Voice Alignment

abstract: This paper presents a novel task, zero-shot voice conversion based on face images (zero-shot FaceVC), which aims at converting the voice characteristics of an utterance from any source speaker to a newly coming target speaker, solely relying on a single face image of the target speaker. To address this task, we propose a face-voice memory-based zero-shot FaceVC method. This method leverages a memory-based face-voice alignment module, in which slots act as the bridge to align these two modalities, allowing for the capture of voice characteristics from face images. A mixed supervision strategy is also introduced to mitigate the long-standing issue of the inconsistency between training and inference phases for voice conversion tasks. To obtain speaker-independent content-related representations, we transfer the knowledge from a pretrained zero-shot voice conversion model to our zero-shot FaceVC model. Considering the differences between FaceVC and traditional voice conversion tasks, systematic subjective and objective metrics are designed to thoroughly evaluate the homogeneity, diversity and consistency of voice characteristics controlled by face images. Through extensive experiments, we demonstrate the superiority of our proposed method on the zero-shot FaceVC task. Samples are presented on our demo website.


title: Epileptic seizure forecasting with long short-term memory (LSTM) neural networks

abstract: Objective: Forecasting epileptic seizures can reduce uncertainty for patients and allow preventative actions. While many models can predict the occurrence of seizures from features of the EEG, few models incorporate changes in features over time. Long Short-Term Memory (LSTM) neural networks are a machine learning architecture that can display temporal dynamics due to the recurrent connections. In this paper, we used LSTMs to monitor changes in EEG features over time to improve the accuracy of seizure forecasts and to alter the time window of the forecast. Methods: Long-term intracranial EEG recordings from eight patients from the NeuroVista dataset were used. A Fourier transform of 1-minute segments of EEG was fed into a Convolutional Neural Network (CNN). The outputs from the CNN were input to three different LSTM models at different time intervals: 1 minute, 1 hour and 1 day. The LSTM model outputs were used to predict seizure onset within a time window. The prediction and start of the time window were separated by the same length of time as the window. Window sizes tested included 2, 4, 10, 20 and 40 minutes. Results and Conclusion: Our model forecast seizure onsets well above a random predictor. Compared to other models using the same dataset, our model performed better for some patients and worse for others. Monitoring the change in EEG features over time allowed our model to produce good results over a range of different window sizes, which is an improvement on previous models and raises the possibility of altering the forecast to meet individual patient needs. Furthermore, a window size of 40 minutes provides a potential intervention time of 40 minutes, which is the first time an intervention time of more than 5 minutes have been forecast using long-term EEG recordings.


title: Reconstructing Existing Levels through Level Inpainting

abstract: Procedural Content Generation (PCG) and Procedural Content Generation via Machine Learning (PCGML) have been used in prior work for generating levels in various games. This paper introduces Content Augmentation and focuses on the subproblem of level inpainting, which involves reconstructing and extending video game levels. Drawing inspiration from image inpainting, we adapt two techniques from this domain to address our specific use case. We present two approaches for level inpainting: an Autoencoder and a U-net. Through a comprehensive case study, we demonstrate their superior performance compared to a baseline method and discuss their relative merits. Furthermore, we provide a practical demonstration of both approaches for the level inpainting task and offer insights into potential directions for future research.


title: Self-supervised Multi-view Clustering in Computer Vision: A Survey

abstract: Multi-view clustering (MVC) has had significant implications in cross-modal representation learning and data-driven decision-making in recent years. It accomplishes this by leveraging the consistency and complementary information among multiple views to cluster samples into distinct groups. However, as contrastive learning continues to evolve within the field of computer vision, self-supervised learning has also made substantial research progress and is progressively becoming dominant in MVC methods. It guides the clustering process by designing proxy tasks to mine the representation of image and video data itself as supervisory information. Despite the rapid development of self-supervised MVC, there has yet to be a comprehensive survey to analyze and summarize the current state of research progress. Therefore, this paper explores the reasons and advantages of the emergence of self-supervised MVC and discusses the internal connections and classifications of common datasets, data issues, representation learning methods, and self-supervised learning methods. This paper does not only introduce the mechanisms for each category of methods but also gives a few examples of how these techniques are used. In the end, some open problems are pointed out for further investigation and development.


title: In Horizon Penetrating Coordinates: Kerr Black Hole Metric Perturbation Construction and Completion

abstract: We investigate the Teukolsky equation in horizon-penetrating coordinates to study the behavior of perturbation waves crossing the outer horizon. For this purpose, we use the null ingoing/outgoing Eddington-Finkelstein coordinates. The first derivative of the radial equation is a Fuchsian differential equation with an additional regular singularity to the ones the radial one has. The radial functions satisfy the physical boundary conditions without imposing any regularity conditions. We also observe that the Hertz-Weyl scalar equations preserve their angular and radial signatures in these coordinates. Using the angular equation, we construct the metric perturbation for a circularly orbiting perturber around a black hole in Kerr spacetime in a horizon-penetrating setting. Furthermore, we completed the missing metric pieces due to the mass M and angular momentum J perturbations. We also provide an explicit formula for the metric perturbation as a function of the radial part, its derivative, and the angular part of the solution to the Teukolsky equation. Finally, we discuss the importance of the extra singularity in the radial derivative for the convergence of the metric expansion.


title: Terahertz magnon frequency comb

abstract: Magnon frequency comb (MFC), the spin-wave spectra composing of equidistant coherent peaks, is attracting much attention in magnonics. A terahertz (THz) MFC, combining the advantages of the THz and MFC technologies, is highly desired because it would significantly advance the MFC applications in ultrafast magnonic metrology, sensing, and communications. Here, we show that the THz MFC can be generated by nonlinear interactions between spin waves and skyrmions in antiferromagnets [Z. Jin \emph{et al}., \href{https://doi.org/10.48550/arXiv.2301.03211}{arXiv:2301.03211}]. It is found that the strength of the three-wave mixing between propagating magnons and breathing skyrmions follows a linear dependence on the driving frequency and the MFC signal can be observed over a broad driving frequency range. Our results extend the working frequency of MFC to the THz regime, which would have potential applications in ultrafast spintronic devices and promote the development of nonlinear magnonics in antiferromagnets.


title: Mechanic Maker 2.0: Reinforcement Learning for Evaluating Generated Rules

abstract: Automated game design (AGD), the study of automatically generating game rules, has a long history in technical games research. AGD approaches generally rely on approximations of human play, either objective functions or AI agents. Despite this, the majority of these approximators are static, meaning they do not reflect human player's ability to learn and improve in a game. In this paper, we investigate the application of Reinforcement Learning (RL) as an approximator for human play for rule generation. We recreate the classic AGD environment Mechanic Maker in Unity as a new, open-source rule generation framework. Our results demonstrate that RL produces distinct sets of rules from an A* agent baseline, which may be more usable by humans.


title: How Much Freedom Does An Effectiveness Metric Really Have?

abstract: It is tempting to assume that because effectiveness metrics have free choice to assign scores to search engine result pages (SERPs) there must thus be a similar degree of freedom as to the relative order that SERP pairs can be put into. In fact that second freedom is, to a considerable degree, illusory. That's because if one SERP in a pair has been given a certain score by a metric, fundamental ordering constraints in many cases then dictate that the score for the second SERP must be either not less than, or not greater than, the score assigned to the first SERP. We refer to these fixed relationships as innate pairwise SERP orderings. Our first goal in this work is to describe and defend those pairwise SERP relationship constraints, and tabulate their relative occurrence via both exhaustive and empirical experimentation. We then consider how to employ such innate pairwise relationships in IR experiments, leading to a proposal for a new measurement paradigm. Specifically, we argue that tables of results in which many different metrics are listed for champion versus challenger system comparisons should be avoided; and that instead a single metric be argued for in principled terms, with any relationships identified by that metric then reinforced via an assessment of the innate relationship as to whether other metrics - indeed, all other metrics - are likely to yield the same system-vs-system outcome.


title: The DECam Ecliptic Exploration Project (DEEP): V. The Absolute Magnitude Distribution of the Cold Classical Kuiper Belt

abstract: The DECam Ecliptic Exploration Project (DEEP) is a deep survey of the trans-Neptunian solar system being carried out on the 4-meter Blanco telescope at Cerro Tololo Inter-American Observatory in Chile using the Dark Energy Camera (DECam). By using a shift-and-stack technique to achieve a mean limiting magnitude of $r \sim 26.2$, DEEP achieves an unprecedented combination of survey area and depth, enabling quantitative leaps forward in our understanding of the Kuiper Belt populations. This work reports results from an analysis of twenty 3 sq.\ deg.\ DECam fields along the invariable plane. We characterize the efficiency and false-positive rates for our moving-object detection pipeline, and use this information to construct a Bayesian signal probability for each detected source. This procedure allows us to treat all of our Kuiper Belt Object (KBO) detections statistically, simultaneously accounting for efficiency and false positives. We detect approximately 2300 candidate sources with KBO-like motion at S/N $>6.5$. We use a subset of these objects to compute the luminosity function of the Kuiper Belt as a whole, as well as the Cold Classical (CC) population. We also investigate the absolute magnitude ($H$) distribution of the CCs, and find consistency with both an exponentially tapered power-law, which is predicted by streaming instability models of planetesimal formation, and a rolling power law. Finally, we provide an updated mass estimate for the Cold Classical Kuiper Belt of $M_{CC}(H_r < 12) = 0.0017^{+0.0010}_{-0.0004} M_{\oplus}$, assuming albedo $p = 0.15$ and density $\rho = 1$ g cm$^{-3}$.


title: LogShrink: Effective Log Compression by Leveraging Commonality and Variability of Log Data

abstract: Log data is a crucial resource for recording system events and states during system execution. However, as systems grow in scale, log data generation has become increasingly explosive, leading to an expensive overhead on log storage, such as several petabytes per day in production. To address this issue, log compression has become a crucial task in reducing disk storage while allowing for further log analysis. Unfortunately, existing general-purpose and log-specific compression methods have been limited in their ability to utilize log data characteristics. To overcome these limitations, we conduct an empirical study and obtain three major observations on the characteristics of log data that can facilitate the log compression task. Based on these observations, we propose LogShrink, a novel and effective log compression method by leveraging commonality and variability of log data. An analyzer based on longest common subsequence and entropy techniques is proposed to identify the latent commonality and variability in log messages. The key idea behind this is that the commonality and variability can be exploited to shrink log data with a shorter representation. Besides, a clustering-based sequence sampler is introduced to accelerate the commonality and variability analyzer. The extensive experimental results demonstrate that LogShrink can exceed baselines in compression ratio by 16% to 356% on average while preserving a reasonable compression speed.


title: Stealthy Physical Masked Face Recognition Attack via Adversarial Style Optimization

abstract: Deep neural networks (DNNs) have achieved state-of-the-art performance on face recognition (FR) tasks in the last decade. In real scenarios, the deployment of DNNs requires taking various face accessories into consideration, like glasses, hats, and masks. In the COVID-19 pandemic era, wearing face masks is one of the most effective ways to defend against the novel coronavirus. However, DNNs are known to be vulnerable to adversarial examples with a small but elaborated perturbation. Thus, a facial mask with adversarial perturbations may pose a great threat to the widely used deep learning-based FR models. In this paper, we consider a challenging adversarial setting: targeted attack against FR models. We propose a new stealthy physical masked FR attack via adversarial style optimization. Specifically, we train an adversarial style mask generator that hides adversarial perturbations inside style masks. Moreover, to ameliorate the phenomenon of sub-optimization with one fixed style, we propose to discover the optimal style given a target through style optimization in a continuous relaxation manner. We simultaneously optimize the generator and the style selection for generating strong and stealthy adversarial style masks. We evaluated the effectiveness and transferability of our proposed method via extensive white-box and black-box digital experiments. Furthermore, we also conducted physical attack experiments against local FR models and online platforms.


title: Estimation and Testing of Forecast Rationality with Many Moments

abstract: We in this paper utilize P-GMM (Cheng and Liao, 2015) moment selection procedure to select valid and relevant moments for estimating and testing forecast rationality under the flexible loss proposed by Elliott et al. (2005). We motivate the moment selection in a large dimensional setting, explain the fundamental mechanism of P-GMM moment selection procedure, and elucidate how to implement it in the context of forecast rationality by allowing the existence of potentially invalid moment conditions. A set of Monte Carlo simulations is conducted to examine the finite sample performance of P-GMM estimation in integrating the information available in instruments into both the estimation and testing, and a real data analysis using data from the Survey of Professional Forecasters issued by the Federal Reserve Bank of Philadelphia is presented to further illustrate the practical value of the suggested methodology. The results indicate that the P-GMM post-selection estimator of forecaster's attitude is comparable to the oracle estimator by using the available information efficiently. The accompanying power of rationality and symmetry tests utilizing P-GMM estimation would be substantially increased through reducing the influence of uninformative instruments. When a forecast user estimates and tests for rationality of forecasts that have been produced by others such as Greenbook, P-GMM moment selection procedure can assist in achieving consistent and more efficient outcomes.


title: Spatio-temporal Co-attention Fusion Network for Video Splicing Localization

abstract: Digital video splicing has become easy and ubiquitous. Malicious users copy some regions of a video and paste them to another video for creating realistic forgeries. It is significant to blindly detect such forgery regions in videos. In this paper, a spatio-temporal co-attention fusion network (SCFNet) is proposed for video splicing localization. Specifically, a three-stream network is used as an encoder to capture manipulation traces across multiple frames. The deep interaction and fusion of spatio-temporal forensic features are achieved by the novel parallel and cross co-attention fusion modules. A lightweight multilayer perceptron (MLP) decoder is adopted to yield a pixel-level tampering localization map. A new large-scale video splicing dataset is created for training the SCFNet. Extensive tests on benchmark datasets show that the localization and generalization performances of our SCFNet outperform the state-of-the-art. Code and datasets will be available at https://github.com/multimediaFor/SCFNet.


title: An Accurate and Efficient Neural Network for OCTA Vessel Segmentation and a New Dataset

abstract: Optical coherence tomography angiography (OCTA) is a noninvasive imaging technique that can reveal high-resolution retinal vessels. In this work, we propose an accurate and efficient neural network for retinal vessel segmentation in OCTA images. The proposed network achieves accuracy comparable to other SOTA methods, while having fewer parameters and faster inference speed (e.g. 110x lighter and 1.3x faster than U-Net), which is very friendly for industrial applications. This is achieved by applying the modified Recurrent ConvNeXt Block to a full resolution convolutional network. In addition, we create a new dataset containing 918 OCTA images and their corresponding vessel annotations. The data set is semi-automatically annotated with the help of Segment Anything Model (SAM), which greatly improves the annotation speed. For the benefit of the community, our code and dataset can be obtained from https://github.com/nhjydywd/OCTA-FRNet.


title: On a Continuum Model for Random Genetic Drift: A Dynamical Boundary Condition Approach

abstract: We propose a new continuum model for a random genetic drift problem by employing a dynamical boundary condition approach. The new model can be viewed as a regularized Kimura equation, which admits a continuous solution and recovers the original system in the limits. The existence and uniqueness of the strong solution of the regularized system are shown. Finally, we present some numerical results for the regularized model, which indicates that the model can capture the main features of the original model.


title: Distributional Estimation of Data Uncertainty for Surveillance Face Anti-spoofing

abstract: Face recognition systems have become increasingly vulnerable to security threats in recent years, prompting the use of Face Anti-spoofing (FAS) to protect against various types of attacks, such as phone unlocking, face payment, and self-service security inspection. While FAS has demonstrated its effectiveness in traditional settings, securing it in long-distance surveillance scenarios presents a significant challenge. These scenarios often feature low-quality face images, necessitating the modeling of data uncertainty to improve stability under extreme conditions. To address this issue, this work proposes Distributional Estimation (DisE), a method that converts traditional FAS point estimation to distributional estimation by modeling data uncertainty during training, including feature (mean) and uncertainty (variance). By adjusting the learning strength of clean and noisy samples for stability and accuracy, the learned uncertainty enhances DisE's performance. The method is evaluated on SuHiFiMask [1], a large-scale and challenging FAS dataset in surveillance scenarios. Results demonstrate that DisE achieves comparable performance on both ACER and AUC metrics.


title: Online Efficient Secure Logistic Regression based on Function Secret Sharing

abstract: Logistic regression is an algorithm widely used for binary classification in various real-world applications such as fraud detection, medical diagnosis, and recommendation systems. However, training a logistic regression model with data from different parties raises privacy concerns. Secure Multi-Party Computation (MPC) is a cryptographic tool that allows multiple parties to train a logistic regression model jointly without compromising privacy. The efficiency of the online training phase becomes crucial when dealing with large-scale data in practice. In this paper, we propose an online efficient protocol for privacy-preserving logistic regression based on Function Secret Sharing (FSS). Our protocols are designed in the two non-colluding servers setting and assume the existence of a third-party dealer who only poses correlated randomness to the computing parties. During the online phase, two servers jointly train a logistic regression model on their private data by utilizing pre-generated correlated randomness. Furthermore, we propose accurate and MPC-friendly alternatives to the sigmoid function and encapsulate the logistic regression training process into a function secret sharing gate. The online communication overhead significantly decreases compared with the traditional secure logistic regression training based on secret sharing. We provide both theoretical and experimental analyses to demonstrate the efficiency and effectiveness of our method.


title: Correlations of dihadron polarization in central, peripheral and ultraperipheral heavy-ion collisions

abstract: While jet quenching in relativistic heavy-ion collisions has been extensively studied over decades, the polarization of quenched hadrons has rarely been discussed. It has recently been proposed that the correlations of dihadron polarization in $e^+e^-$ and $pp$ collisions provide a novel probe of the longitudinal spin transfer from hard partons to hadrons without requiring the colliding beams to be polarized. To support realistic experimental measurement of dihadron polarization with sufficient luminosity, we extend the aforementioned study to relativistic heavy-ion collisions by convoluting the vacuum fragmentation of partons with their energy loss inside the quark-gluon plasma (QGP). We find that while the correlation functions of $\Lambda$-$\Lambda$ (or $\Lambda$-$\bar{\Lambda}$) polarization in peripheral collisions is consistent with those in $pp$ collisions, clear enhancement can be seen in central collisions. These correlation functions appear sensitive to different assumptions in the DSV parameterization of parton fragmentation functions, and therefore could place additional constraints on the spin-dependent fragmentation functions of quarks and gluons. The correlation of dihadron polarization has also been explored in ultraperipheral heavy-ion collisions, which provides a cleaner probe of fragmentation functions of quarks produced by energetic photon-photon and photon-pomeron interactions.


title: Generator coordinate method for nuclear octupole excitations: status and perspectives

abstract: Strong octupole correlations have been observed in the low-lying states of atomic nuclei across various mass regions. In this review, we provide an overview of Beyond Mean-Field (BMF) studies of nuclear octupole collective motions with Generator Coordinate Method (GCM) in combination with quantum-number projections that are implemented to restore the broken symmetries in nuclear mean-field states. We highlight recent developments within this framework and their applications to excitation spectra and electromagnetic transition rates in octupole-shaped nuclei and hypernuclei. We discuss the novel phenomena of nucleon clustering in light nuclei. Additionally, we explore the phase transition from octupole vibrations to rotational motions as spin increases in heavy nuclei. Lastly, we examine the status and future prospects of studies on octupole deformation effects in nuclear Schiff moments. These studies, along with the upper limits of atomic Electric Dipole Moment (EDM), impose stringent constraints on beyond-standard-model time-reversal-violating nucleon-nucleon interactions.


title: Positivity of tangent sheaves of projective varieties -- the structure of MRC fibrations

abstract: In this paper, we extend the structure theorem for smooth projective varieties with nef tangent bundle to projective klt varieties whose tangent sheaf is either positively curved or almost nef. Specifically, we show that such a variety $X$, up to a finite quasi-\'etale cover, admits a rationally connected fibration $X \to A$ onto an abelian variety $A$. For the proof, we develop the theory of positivity of coherent sheaves on projective varieties. As applications, we establish some relations between the geometric properties and positivity of tangent sheaves.


title: Self-supervised TransUNet for Ultrasound regional segmentation of the distal radius in children

abstract: Supervised deep learning offers great promise to automate analysis of medical images from segmentation to diagnosis. However, their performance highly relies on the quality and quantity of the data annotation. Meanwhile, curating large annotated datasets for medical images requires a high level of expertise, which is time-consuming and expensive. Recently, to quench the thirst for large data sets with high-quality annotation, self-supervised learning (SSL) methods using unlabeled domain-specific data, have attracted attention. Therefore, designing an SSL method that relies on minimal quantities of labeled data has far-reaching significance in medical images. This paper investigates the feasibility of deploying the Masked Autoencoder for SSL (SSL-MAE) of TransUNet, for segmenting bony regions from children's wrist ultrasound scans. We found that changing the embedding and loss function in SSL-MAE can produce better downstream results compared to the original SSL-MAE. In addition, we determined that only pretraining TransUNet embedding and encoder with SSL-MAE does not work as well as TransUNet without SSL-MAE pretraining on downstream segmentation tasks.


title: Polynomial identities and Fermat quotients

abstract: We prove some polynomial identities from which we deduce congruences modulo $p^2$ for the Fermat quotient $\frac{2^p-2}{p}$ for any odd prime $p$ (Proposition 1 and Theorem 1). These congruences are simpler than the one obtained by Jothilingam in 1985 which involves listing quadratic residues in some order. On the way, we also observe some more congruences for the Fermat quotient that generalize Eisenstein's classical congruence. Using such polynomial identities, we obtain some sums involving harmonic numbers. We also prove formulae for binomial sums of harmonic numbers of higher order.


title: Target-aware Bi-Transformer for Few-shot Segmentation

abstract: Traditional semantic segmentation tasks require a large number of labels and are difficult to identify unlearned categories. Few-shot semantic segmentation (FSS) aims to use limited labeled support images to identify the segmentation of new classes of objects, which is very practical in the real world. Previous researches were primarily based on prototypes or correlations. Due to colors, textures, and styles are similar in the same image, we argue that the query image can be regarded as its own support image. In this paper, we proposed the Target-aware Bi-Transformer Network (TBTNet) to equivalent treat of support images and query image. A vigorous Target-aware Transformer Layer (TTL) also be designed to distill correlations and force the model to focus on foreground information. It treats the hypercorrelation as a feature, resulting a significant reduction in the number of feature channels. Benefit from this characteristic, our model is the lightest up to now with only 0.4M learnable parameters. Futhermore, TBTNet converges in only 10% to 25% of the training epochs compared to traditional methods. The excellent performance on standard FSS benchmarks of PASCAL-5i and COCO-20i proves the efficiency of our method. Extensive ablation studies were also carried out to evaluate the effectiveness of Bi-Transformer architecture and TTL.


title: HiFTNet: A Fast High-Quality Neural Vocoder with Harmonic-plus-Noise Filter and Inverse Short Time Fourier Transform

abstract: Recent advancements in speech synthesis have leveraged GAN-based networks like HiFi-GAN and BigVGAN to produce high-fidelity waveforms from mel-spectrograms. However, these networks are computationally expensive and parameter-heavy. iSTFTNet addresses these limitations by integrating inverse short-time Fourier transform (iSTFT) into the network, achieving both speed and parameter efficiency. In this paper, we introduce an extension to iSTFTNet, termed HiFTNet, which incorporates a harmonic-plus-noise source filter in the time-frequency domain that uses a sinusoidal source from the fundamental frequency (F0) inferred via a pre-trained F0 estimation network for fast inference speed. Subjective evaluations on LJSpeech show that our model significantly outperforms both iSTFTNet and HiFi-GAN, achieving ground-truth-level performance. HiFTNet also outperforms BigVGAN-base on LibriTTS for unseen speakers and achieves comparable performance to BigVGAN while being four times faster with only $1/6$ of the parameters. Our work sets a new benchmark for efficient, high-quality neural vocoding, paving the way for real-time applications that demand high quality speech synthesis.


title: Superconductivity in the bcc-type High-entropy Alloy TiHfNbTaMo

abstract: X-ray powder diffraction, electrical resistivity, magnetization, and thermodynamic measurements were conducted to investigate the structure and superconducting properties of TiHfNbTaMo, a novel high-entropy alloy possessing a valence electron count (VEC) of 4.8. The TiHfNbTaMo HEA was discovered to have a body-centered cubic structure and a microscopically homogeneous distribution of the constituent elements. This material shows type-II superconductivity with Tc = 3.42 K, lower critical field with 22.8 mT, and upper critical field with 3.95 T. Low-temperature specific heat measurements show that the alloy is a conventional s-wave type with a moderately coupled superconductor. First-principles calculations show that the density of states (DOS) of the TiHfNbTaMo alloy is dominated by hybrid d orbitals of these five metal elements. Additionally, the TiHfNbTaMo HEA exhibits three van Hove singularities. Furthermore, the VEC and the composition of the elements (especially the Nb elemental content) affect the Tc of the bcc-type HEA.


title: PwR: Exploring the Role of Representations in Conversational Programming

abstract: Large Language Models (LLMs) have revolutionized programming and software engineering. AI programming assistants such as GitHub Copilot X enable conversational programming, narrowing the gap between human intent and code generation. However, prior literature has identified a key challenge--there is a gap between user's mental model of the system's understanding after a sequence of natural language utterances, and the AI system's actual understanding. To address this, we introduce Programming with Representations (PwR), an approach that uses representations to convey the system's understanding back to the user in natural language. We conducted an in-lab task-centered study with 14 users of varying programming proficiency and found that representations significantly improve understandability, and instilled a sense of agency among our participants. Expert programmers use them for verification, while intermediate programmers benefit from confirmation. Natural language-based development with LLMs, coupled with representations, promises to transform software development, making it more accessible and efficient.


title: CLIP-based Synergistic Knowledge Transfer for Text-based Person Retrieval

abstract: Text-based Person Retrieval (TPR) aims to retrieve the target person images given a textual query. The primary challenge lies in bridging the substantial gap between vision and language modalities, especially when dealing with limited large-scale datasets. In this paper, we introduce a CLIP-based Synergistic Knowledge Transfer (CSKT) approach for TPR. Specifically, to explore the CLIP's knowledge on input side, we first propose a Bidirectional Prompts Transferring (BPT) module constructed by text-to-image and image-to-text bidirectional prompts and coupling projections. Secondly, Dual Adapters Transferring (DAT) is designed to transfer knowledge on output side of Multi-Head Attention (MHA) in vision and language. This synergistic two-way collaborative mechanism promotes the early-stage feature fusion and efficiently exploits the existing knowledge of CLIP. CSKT outperforms the state-of-the-art approaches across three benchmark datasets when the training parameters merely account for 7.4% of the entire model, demonstrating its remarkable efficiency, effectiveness and generalization.


title: Search and Learning for Unsupervised Text Generation

abstract: With the advances of deep learning techniques, text generation is attracting increasing interest in the artificial intelligence (AI) community, because of its wide applications and because it is an essential component of AI. Traditional text generation systems are trained in a supervised way, requiring massive labeled parallel corpora. In this paper, I will introduce our recent work on search and learning approaches to unsupervised text generation, where a heuristic objective function estimates the quality of a candidate sentence, and discrete search algorithms generate a sentence by maximizing the search objective. A machine learning model further learns from the search results to smooth out noise and improve efficiency. Our approach is important to the industry for building minimal viable products for a new task; it also has high social impacts for saving human annotation labor and for processing low-resource languages.


title: Combating Advanced Persistent Threats: Challenges and Solutions

abstract: The rise of advanced persistent threats (APTs) has marked a significant cybersecurity challenge, characterized by sophisticated orchestration, stealthy execution, extended persistence, and targeting valuable assets across diverse sectors. Provenance graph-based kernel-level auditing has emerged as a promising approach to enhance visibility and traceability within intricate network environments. However, it still faces challenges including reconstructing complex lateral attack chains, detecting dynamic evasion behaviors, and defending smart adversarial subgraphs. To bridge the research gap, this paper proposes an efficient and robust APT defense scheme leveraging provenance graphs, including a network-level distributed audit model for cost-effective lateral attack reconstruction, a trust-oriented APT evasion behavior detection strategy, and a hidden Markov model based adversarial subgraph defense approach. Through prototype implementation and extensive experiments, we validate the effectiveness of our system. Lastly, crucial open research directions are outlined in this emerging field.


title: Weak Operator Continuity for Evolutionary Equations

abstract: Considering evolutionary equations in the sense of Picard, we identify a certain topology for material laws rendering the solution operator continuous if considered as a mapping from the material laws into the set of bounded linear operators, where the latter are endowed with the weak operator topology. The topology is a topology of vector-valued holomorphic functions and provides a lift of the previously introduced nonlocal $\mathrm{H}$-topology to particular holomorphic functions. The main area of applications are nonlocal homogenisation results for coupled systems of time-dependent partial differential equations. A continuous dependence result for a nonlocal model for cell migration is also provided.


title: PromptST: Prompt-Enhanced Spatio-Temporal Multi-Attribute Prediction

abstract: In the era of information explosion, spatio-temporal data mining serves as a critical part of urban management. Considering the various fields demanding attention, e.g., traffic state, human activity, and social event, predicting multiple spatio-temporal attributes simultaneously can alleviate regulatory pressure and foster smart city construction. However, current research can not handle the spatio-temporal multi-attribute prediction well due to the complex relationships between diverse attributes. The key challenge lies in how to address the common spatio-temporal patterns while tackling their distinctions. In this paper, we propose an effective solution for spatio-temporal multi-attribute prediction, PromptST. We devise a spatio-temporal transformer and a parameter-sharing training scheme to address the common knowledge among different spatio-temporal attributes. Then, we elaborate a spatio-temporal prompt tuning strategy to fit the specific attributes in a lightweight manner. Through the pretrain and prompt tuning phases, our PromptST is able to enhance the specific spatio-temoral characteristic capture by prompting the backbone model to fit the specific target attribute while maintaining the learned common knowledge. Extensive experiments on real-world datasets verify that our PromptST attains state-of-the-art performance. Furthermore, we also prove PromptST owns good transferability on unseen spatio-temporal attributes, which brings promising application potential in urban computing. The implementation code is available to ease reproducibility.


title: Discovering Sounding Objects by Audio Queries for Audio Visual Segmentation

abstract: Audio visual segmentation (AVS) aims to segment the sounding objects for each frame of a given video. To distinguish the sounding objects from silent ones, both audio-visual semantic correspondence and temporal interaction are required. The previous method applies multi-frame cross-modal attention to conduct pixel-level interactions between audio features and visual features of multiple frames simultaneously, which is both redundant and implicit. In this paper, we propose an Audio-Queried Transformer architecture, AQFormer, where we define a set of object queries conditioned on audio information and associate each of them to particular sounding objects. Explicit object-level semantic correspondence between audio and visual modalities is established by gathering object information from visual features with predefined audio queries. Besides, an Audio-Bridged Temporal Interaction module is proposed to exchange sounding object-relevant information among multiple frames with the bridge of audio features. Extensive experiments are conducted on two AVS benchmarks to show that our method achieves state-of-the-art performances, especially 7.1% M_J and 7.6% M_F gains on the MS3 setting.


title: RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervision

abstract: 3D occupancy prediction holds significant promise in the fields of robot perception and autonomous driving, which quantifies 3D scenes into grid cells with semantic labels. Recent works mainly utilize complete occupancy labels in 3D voxel space for supervision. However, the expensive annotation process and sometimes ambiguous labels have severely constrained the usability and scalability of 3D occupancy models. To address this, we present RenderOcc, a novel paradigm for training 3D occupancy models only using 2D labels. Specifically, we extract a NeRF-style 3D volume representation from multi-view images, and employ volume rendering techniques to establish 2D renderings, thus enabling direct 3D supervision from 2D semantics and depth labels. Additionally, we introduce an Auxiliary Ray method to tackle the issue of sparse viewpoints in autonomous driving scenarios, which leverages sequential frames to construct comprehensive 2D rendering for each object. To our best knowledge, RenderOcc is the first attempt to train multi-view 3D occupancy models only using 2D labels, reducing the dependence on costly 3D occupancy annotations. Extensive experiments demonstrate that RenderOcc achieves comparable performance to models fully supervised with 3D labels, underscoring the significance of this approach in real-world applications.


title: Binary perm algebras and alternative algebras

abstract: In this paper, we describe the defining identities of a variety of binary perm algebras which is a subvariety of the variety of alternative algebras. Moreover, we construct a basis of the free binary perm algebra. In addition, we describe subalgebras of binary perm algebras under commutator, which are related to Malcev algebras.


title: Undecidability of translational monotilings

abstract: In the 60's, Berger famously showed that translational tilings of $\mathbb{Z}^2$ with multiple tiles are algorithmically undecidable. Recently, Bhattacharya proved the decidability of translational monotilings (tilings by translations of a single tile) in $\mathbb{Z}^2$. The decidability of translational monotilings in higher dimensions remained unsolved. In this paper, by combining our recently developed techniques with ideas introduced by Aanderaa and Lewis, we finally settle this problem, achieving the undecidability of translational monotilings of (periodic subsets of) virtually $\mathbb{Z}^2$ spaces, namely, spaces of the form $\mathbb{Z}^2\times G_0$, where $G_0$ is a finite Abelian group. This also implies the undecidability of translational monotilings in $\mathbb{Z}^d$, $d\geq 3$.


title: Outlier-Insensitive Kalman Filtering: Theory and Applications

abstract: State estimation of dynamical systems from noisy observations is a fundamental task in many applications. It is commonly addressed using the linear Kalman filter (KF), whose performance can significantly degrade in the presence of outliers in the observations, due to the sensitivity of its convex quadratic objective function. To mitigate such behavior, outlier detection algorithms can be applied. In this work, we propose a parameter-free algorithm which mitigates the harmful effect of outliers while requiring only a short iterative process of the standard update step of the KF. To that end, we model each potential outlier as a normal process with unknown variance and apply online estimation through either expectation maximization or alternating maximization algorithms. Simulations and field experiment evaluations demonstrate competitive performance of our method, showcasing its robustness to outliers in filtering scenarios compared to alternative algorithms.


title: LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Models

abstract: Graphic layout generation, a growing research field, plays a significant role in user engagement and information perception. Existing methods primarily treat layout generation as a numerical optimization task, focusing on quantitative aspects while overlooking the semantic information of layout, such as the relationship between each layout element. In this paper, we propose LayoutNUWA, the first model that treats layout generation as a code generation task to enhance semantic information and harness the hidden layout expertise of large language models~(LLMs). More concretely, we develop a Code Instruct Tuning (CIT) approach comprising three interconnected modules: 1) the Code Initialization (CI) module quantifies the numerical conditions and initializes them as HTML code with strategically placed masks; 2) the Code Completion (CC) module employs the formatting knowledge of LLMs to fill in the masked portions within the HTML code; 3) the Code Rendering (CR) module transforms the completed code into the final layout output, ensuring a highly interpretable and transparent layout generation procedure that directly maps code to a visualized layout. We attain significant state-of-the-art performance (even over 50\% improvements) on multiple datasets, showcasing the strong capabilities of LayoutNUWA. Our code is available at https://github.com/ProjectNUWA/LayoutNUWA.


title: Pruning Large Language Models via Accuracy Predictor

abstract: Large language models(LLMs) containing tens of billions of parameters (or even more) have demonstrated impressive capabilities in various NLP tasks. However, substantial model size poses challenges to training, inference, and deployment so that it is necessary to compress the model. At present, most model compression for LLMs requires manual design of pruning features, which has problems such as complex optimization pipeline and difficulty in retaining the capabilities of certain parts of the model.Therefore, we propose a novel pruning approach: firstly, a training set of a certain number of architecture-accuracy pairs is established, and then a non-neural model is trained as an accuracy predictor. Using the accuracy predictor to further optimize the search space and search, the optimal model can be automatically selected. Experiments show that our proposed approach is effective and efficient. Compared with the baseline, the perplexity(PPL) on Wikitext2 and PTB dropped by 9.48% and 5,76% respectively, and the average accuracy of MMLU increased by 6.28%.


title: Understanding Divergent Framing of the Supreme Court Controversies: Social Media vs. News Outlets

abstract: Understanding the framing of political issues is of paramount importance as it significantly shapes how individuals perceive, interpret, and engage with these matters. While prior research has independently explored framing within news media and by social media users, there remains a notable gap in our comprehension of the disparities in framing political issues between these two distinct groups. To address this gap, we conduct a comprehensive investigation, focusing on the nuanced distinctions both qualitatively and quantitatively in the framing of social media and traditional media outlets concerning a series of American Supreme Court rulings on affirmative action, student loans, and abortion rights. Our findings reveal that, while some overlap in framing exists between social media and traditional media outlets, substantial differences emerge both across various topics and within specific framing categories. Compared to traditional news media, social media platforms tend to present more polarized stances across all framing categories. Further, we observe significant polarization in the news media's treatment (i.e., Left vs. Right leaning media) of affirmative action and abortion rights, whereas the topic of student loans tends to exhibit a greater degree of consensus. The disparities in framing between traditional and social media platforms carry significant implications for the formation of public opinion, policy decision-making, and the broader political landscape.


title: Anomalous transport of small polarons arises from transient lattice relaxation or immovable boundaries

abstract: Elucidating transport mechanisms and predicting transport coefficients is crucial for advancing material innovation, design, and application. Yet, state-of-the-art calculations are restricted to exact simulations of small lattices with severe finite-size effects or approximate simulations that assume the nature of transport. We leverage recent algorithmic advances to perform exact simulations of the celebrated Holstein model that systematically quantify and eliminate finite-size effects to gain insights into small polaron formation and the nature and timescales of its transport. We perform the first systematic comparison of the performance of two distinct approaches to predict charge carrier mobility: equilibrium-based Green-Kubo relations and nonequilibrium relaxation methods. Our investigation uncovers when and why disparities arise between these ubiquitously used techniques, revealing that the equilibrium-based method is highly sensitive to system topology whereas the nonequilibrium approach requires bigger system sizes to reveal its diffusive region. Contrary to assumptions made in standard perturbative calculations, our results demonstrate that small polarons exhibit anomalous transport and that it manifests transiently, due to nonequilibrium lattice relaxation, or permanently, as a signature of immovable boundaries. These findings have consequences for applications including the utilization of organic polymers in organic electronics and transition metal oxides in photocatalysis.


title: Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark for Speech

abstract: Text language models have shown remarkable zero-shot capability in generalizing to unseen tasks when provided with well-formulated instructions. However, existing studies in speech processing primarily focus on limited or specific tasks. Moreover, the lack of standardized benchmarks hinders a fair comparison across different approaches. Thus, we present Dynamic-SUPERB, a benchmark designed for building universal speech models capable of leveraging instruction tuning to perform multiple tasks in a zero-shot fashion. To achieve comprehensive coverage of diverse speech tasks and harness instruction tuning, we invite the community to collaborate and contribute, facilitating the dynamic growth of the benchmark. To initiate, Dynamic-SUPERB features 55 evaluation instances by combining 33 tasks and 22 datasets. This spans a broad spectrum of dimensions, providing a comprehensive platform for evaluation. Additionally, we propose several approaches to establish benchmark baselines. These include the utilization of speech models, text language models, and the multimodal encoder. Evaluation results indicate that while these baselines perform reasonably on seen tasks, they struggle with unseen ones. We release all materials to the public and welcome researchers to collaborate on the project, advancing technologies in the field together.


title: Surface directed spinodal decomposition of fluids confined in cylindrical pore

abstract: The surface directed spinodal decomposition of a binary liquid confined inside cylindrical pore is investigated using molecular dynamics simulation. One component of the liquid wets the pore surface while the other remains neutral. A variety of wetting conditions are studied. For the partial wetting case, after an initial period of phase separation, the domains organize themselves into plug-like structure and the system enters into a metastable state. Therefore, a complete phase separation is never achieved. Analysis of domain growth and the structure factor suggests an one-dimensional growth dynamics for partial wetting case. As the wetting interaction is increased beyond a critical value, a transition from the plug-like to tube-like domain formation is observed which corresponds to the full wetting morphology. Thus, a complete phase separation is achieved as the wetting species moves towards the pore surface and forms layers enclosing the non wetting species residing around the axis of the cylinder. The coarsening dynamics of both the species are studied separately. The wetting species is found to follow a two-dimensional domain growth dynamics with a growth exponent 1/2 in the viscous hydrodynamic regime. This was substantiated by the Porod tail of the structure factor. On the other hand, the domain grows linearly with time for the non wetting species. This suggests that the non wetting species behaves akin to a three-dimensional bulk system. An appropriate reasoning is presented to justify the given observations.


title: Extrinsic nonlinear Kerr rotation in topological materials under a magnetic field

abstract: Topological properties in quantum materials are often governed by symmetry and tuned by crystal structure and external fields, and hence symmetry-sensitive nonlinear optical measurements in a magnetic field are a valuable probe. Here we report nonlinear magneto-optical second harmonic generation (SHG) studies of non-magnetic topological materials including bilayer WTe2, monolayer WSe2 and bulk TaAs. The polarization-resolved patterns of optical SHG under magnetic field show nonlinear Kerr rotation in these time-reversal symmetric materials. For materials with three-fold rotational symmetric lattice structure, the SHG polarization pattern rotates just slightly in a magnetic field, whereas in those with mirror or two-fold rotational symmetry the SHG polarization pattern rotates greatly and distorts. These different magneto-SHG characters can be understood by considering the superposition of the magnetic field-induced time-noninvariant nonlinear optical tensor and the crystal-structure-based time-invariant counterpart. The situation is further clarified by scrutinizing the Faraday rotation, whose subtle interplay with crystal symmetry accounts for the diverse behavior of the extrinsic nonlinear Kerr rotation in different materials. Our work illustrates the application of magneto-SHG techniques to directly probe nontrivial topological properties, and underlines the importance of minimizing extrinsic nonlinear Kerr rotation in polarization-resolved magneto-optical studies.


title: Learning Parallax for Stereo Event-based Motion Deblurring

abstract: Due to the extremely low latency, events have been recently exploited to supplement lost information for motion deblurring. Existing approaches largely rely on the perfect pixel-wise alignment between intensity images and events, which is not always fulfilled in the real world. To tackle this problem, we propose a novel coarse-to-fine framework, named NETwork of Event-based motion Deblurring with STereo event and intensity cameras (St-EDNet), to recover high-quality images directly from the misaligned inputs, consisting of a single blurry image and the concurrent event streams. Specifically, the coarse spatial alignment of the blurry image and the event streams is first implemented with a cross-modal stereo matching module without the need for ground-truth depths. Then, a dual-feature embedding architecture is proposed to gradually build the fine bidirectional association of the coarsely aligned data and reconstruct the sequence of the latent sharp images. Furthermore, we build a new dataset with STereo Event and Intensity Cameras (StEIC), containing real-world events, intensity images, and dense disparity maps. Experiments on real-world datasets demonstrate the superiority of the proposed network over state-of-the-art methods.


title: PanoMixSwap Panorama Mixing via Structural Swapping for Indoor Scene Understanding

abstract: The volume and diversity of training data are critical for modern deep learningbased methods. Compared to the massive amount of labeled perspective images, 360 panoramic images fall short in both volume and diversity. In this paper, we propose PanoMixSwap, a novel data augmentation technique specifically designed for indoor panoramic images. PanoMixSwap explicitly mixes various background styles, foreground furniture, and room layouts from the existing indoor panorama datasets and generates a diverse set of new panoramic images to enrich the datasets. We first decompose each panoramic image into its constituent parts: background style, foreground furniture, and room layout. Then, we generate an augmented image by mixing these three parts from three different images, such as the foreground furniture from one image, the background style from another image, and the room structure from the third image. Our method yields high diversity since there is a cubical increase in image combinations. We also evaluate the effectiveness of PanoMixSwap on two indoor scene understanding tasks: semantic segmentation and layout estimation. Our experiments demonstrate that state-of-the-art methods trained with PanoMixSwap outperform their original setting on both tasks consistently.


title: Sparse and Privacy-enhanced Representation for Human Pose Estimation

abstract: We propose a sparse and privacy-enhanced representation for Human Pose Estimation (HPE). Given a perspective camera, we use a proprietary motion vector sensor(MVS) to extract an edge image and a two-directional motion vector image at each time frame. Both edge and motion vector images are sparse and contain much less information (i.e., enhancing human privacy). We advocate that edge information is essential for HPE, and motion vectors complement edge information during fast movements. We propose a fusion network leveraging recent advances in sparse convolution used typically for 3D voxels to efficiently process our proposed sparse representation, which achieves about 13x speed-up and 96% reduction in FLOPs. We collect an in-house edge and motion vector dataset with 16 types of actions by 40 users using the proprietary MVS. Our method outperforms individual modalities using only edge or motion vector images. Finally, we validate the privacy-enhanced quality of our sparse representation through face recognition on CelebA (a large face dataset) and a user study on our in-house dataset.


title: On the gamma difference distribution

abstract: The gamma difference distribution is defined as the difference of two gamma distributions, with in general different shape and rate parameters. Starting with knowledge of the corresponding characteristic function, a second order linear differential equation characterisation of the probability density function is given. This is used to derive a Stein-type differential identity relating to the expectation with respect to the gamma difference distribution of a general twice differentiable function $g(x)$. Choosing $g(x) = x^k$ gives a second order recurrence for the positive integer moments, which are also shown to permit evaluations in terms of ${}_2 F_1$ hypergeometric polynomials. A hypergeometric function evaluation is given for the absolute continuous moments. Specialising the gamma difference distribution gives the variance gamma distribution. Results of the type obtained herein have previously been obtained for this distribution, allowing for comparisons to be made.


title: FedGKD: Unleashing the Power of Collaboration in Federated Graph Neural Networks

abstract: Federated training of Graph Neural Networks (GNN) has become popular in recent years due to its ability to perform graph-related tasks under data isolation scenarios while preserving data privacy. However, graph heterogeneity issues in federated GNN systems continue to pose challenges. Existing frameworks address the problem by representing local tasks using different statistics and relating them through a simple aggregation mechanism. However, these approaches suffer from limited efficiency from two aspects: low quality of task-relatedness quantification and inefficacy of exploiting the collaboration structure. To address these issues, we propose FedGKD, a novel federated GNN framework that utilizes a novel client-side graph dataset distillation method to extract task features that better describe task-relatedness, and introduces a novel server-side aggregation mechanism that is aware of the global collaboration structure. We conduct extensive experiments on six real-world datasets of different scales, demonstrating our framework's outperformance.


title: NOMAD: A Natural, Occluded, Multi-scale Aerial Dataset, for Emergency Response Scenarios

abstract: With the increasing reliance on small Unmanned Aerial Systems (sUAS) for Emergency Response Scenarios, such as Search and Rescue, the integration of computer vision capabilities has become a key factor in mission success. Nevertheless, computer vision performance for detecting humans severely degrades when shifting from ground to aerial views. Several aerial datasets have been created to mitigate this problem, however, none of them has specifically addressed the issue of occlusion, a critical component in Emergency Response Scenarios. Natural Occluded Multi-scale Aerial Dataset (NOMAD) presents a benchmark for human detection under occluded aerial views, with five different aerial distances and rich imagery variance. NOMAD is composed of 100 different Actors, all performing sequences of walking, laying and hiding. It includes 42,825 frames, extracted from 5.4k resolution videos, and manually annotated with a bounding box and a label describing 10 different visibility levels, categorized according to the percentage of the human body visible inside the bounding box. This allows computer vision models to be evaluated on their detection performance across different ranges of occlusion. NOMAD is designed to improve the effectiveness of aerial search and rescue and to enhance collaboration between sUAS and humans, by providing a new benchmark dataset for human detection under occluded aerial views.


title: Magnetically Confined Mountains on Accreting Neutron Stars in General Relativity

abstract: The general relativistic formulation of the problem of magnetically confined mountains on neutron stars is presented, and the resulting equations are solved numerically, generalising previous Newtonian calculations. The hydromagnetic structure of the accreted matter and the subsequent magnetic burial of the star's magnetic dipole moment are computed. Overall, it is observed that relativistic corrections reduce the hydromagnetic deformation associated with the mountain. The magnetic field lines are curved more gently than in previous calculations, and the screening of the dipole moment is reduced. Quantitatively, it is found that the dimensionless dipole moment ($m_{\rm d}$) depends on the accreted mass ($M_{\rm a}$) as $m_{\rm d} = -3.2\times10^{3}M_{\rm a}/M_\odot + 1.0$, implying approximately three times less screening compared to the Newtonian theory. Additionally, the characteristic scale height of the mountain, governing the gradients of quantities like pressure, density, and magnetic field strength, reduces by approximately $40\%$ for an isothermal equation of state.


title: A generalization of the Newton-based matrix splitting iteration method for generalized absolute value equations

abstract: A generalization of the Newton-based matrix splitting iteration method (GNMS) for solving the generalized absolute value equations (GAVEs) is proposed. Under mild conditions, the GNMS method converges to the unique solution of the GAVEs. Moreover, we can obtain a few weaker convergence conditions for some existing methods. Numerical results verify the effectiveness of the proposed method.


title: Large Nonreciprocity of Shear-Horizontal Surface Acoustic Waves induced by Magnetoelastic Bilayers

abstract: We report large nonreciprocity in the transmission of shear-horizontal surface acoustic waves (SAWs) on LiTaO3 substrate coated with a FeCoSiB/NiFeCu magnetoelastic bilayer. The large difference in saturation magnetization of the two layers not only brings nonreciprocal spin waves (SWs), but also ensures the phonon-magnon (SAWs-SWs) coupling at relatively low wavenumbers. It is found that the angle between the magnetization and the wavevector play important roles in determining the strength of magnetoelastic coupling and nonreciprocity, simultaneously. A large nonreciprocal transmission of SAWs about 30 dB (i.e. 60 dB/mm) is demonstrated at 2.33 GHz. In addition, the dispersion relation between coupled SH-SAWs and nonreciprocal SWs is developed, which provide a good insight into the observed phenomena. Our results offer a convenient approach to implement nonreciprocal SAW isolators or circulators.


title: TOPr: Enhanced Static Code Pruning for Fast and Precise Directed Fuzzing

abstract: Directed fuzzing is a dynamic testing technique that focuses exploration on specific, pre targeted program locations. Like other types of fuzzers, directed fuzzers are most effective when maximizing testing speed and precision. To this end, recent directed fuzzers have begun leveraging path pruning: preventing the wasteful testing of program paths deemed irrelevant to reaching a desired target location. Yet, despite code pruning's substantial speedup, current approaches are imprecise failing to capture indirect control flow requiring additional dynamic analyses that diminish directed fuzzers' speeds. Thus, without code pruning that is both fast and precise, directed fuzzers' effectiveness will continue to remain limited. This paper aims to tackle the challenge of upholding both speed and precision in pruning-based directed fuzzing. We show that existing pruning approaches fail to recover common case indirect control flow; and identify opportunities to enhance them with lightweight heuristics namely, function signature matching enabling them to maximize precision without the burden of dynamic analysis. We implement our enhanced pruning as a prototype, TOPr (Target Oriented Pruning), and evaluate it against the leading pruning based and pruning agnostic directed fuzzers SieveFuzz and AFLGo. We show that TOPr's enhanced pruning outperforms these fuzzers in (1) speed (achieving 222% and 73% higher test case throughput, respectively); (2) reachability (achieving 149% and 9% more target relevant coverage, respectively); and (3) bug discovery time (triggering bugs faster 85% and 8%, respectively). Furthermore, TOPr's balance of speed and precision enables it to find 24 new bugs in 5 open source applications, with 18 confirmed by developers, 12 bugs labelled as "Priority - 1. High", and 12 bugs fixed, underscoring the effectiveness of our framework.


title: Modeling ballistic aggregation by time stepping approaches

abstract: This paper deals with the problem of simulating dense dispersed systems composed by large numbers of particles undergoing ballistic aggregation. The most classical approaches for dealing with such problems are represented by the so-called event-driven methods. Despite being more accurate, these methods become computationally very expensive as the number of particles increases. Typically, their computational cost is proportional to the square of the number of particles and thus they become extremely demanding as soon as this number becomes sufficiently large. An alternative approach, called time-stepping, consists in evolving the problem over small time-intervals and to handle all collisions occurring during each time interval simultaneously. In this work, we follow this second direction and we introduce a new time stepping method which recasts the problem of the multiple collisions in a minimization framework. The objective of this work is twofold, first to show that the statistical description of the resulting aggregates obtained with this new time stepping method is sufficiently close to that of the event driven methods. The second goal consists in showing that the computational performance considerably improve when the number of particles becomes sufficiently large. Numerical results obtained in the case of spherical particles moving in a two dimensional box show that these two properties are indeed satisfied by this new method.