title: Shogi and Frieze group

abstract: Shogi is a traditional Japanese strategy board game in the same family as chess, chaturanga, and xiangqi, and has been theoretically studied from various aspects. The research on recommended sequences of moves in each opening of shogi is called joseki; how to use a rook (Static Rook and Ranging Rook), or how to develop a castle, etc. Also, many pieces of tsume shogi, artistic shogi miniature problems, in which the opponent's king is checkmated by a series of checks, have been created involving various beautiful techniques such as "saw" and "puzzle ring". In addition, the rapid development of AI in recent years has led to the pursuit of the best possible moves in shogi. In this paper, we move away from the study of winning and losing in shogi and focus on the mathematical aspects of the movement of shogi pieces. We propose to correspond movements of shogi pieces to a set of geometrical patterns constructed by the shape of shogi pieces and representing the Frieze group through the condition regarding the neighborhood of arrangements of given shogi pieces. Although the discovery of this correspondence does not lead to a winning strategy for shogi, however, it does demonstrate a curious involvement between the traditional Japanese board game and Western mathematics.


title: Double Extensions of Multiplicative Restricted Hom-Lie Algebras

abstract: In this paper, we study the double extension of a restricted quadratic Hom-Lie algebra $(V,[\cdot,\cdot]_{V},\alpha_{V},B_{V})$, which is an enlargement of $V$ by means of a central extension and a restricted derivation $\mathscr{D}$. In particular, we prove that the double extension of a restricted quadratic Hom-Lie algebra $V$ with a $\mathscr{D}$-invariant bilinear form $B_{V}$ is restricted. Conversely, any irreducible restricted quadratic Hom-Lie algebra with nonzero center is proved to be the double extension of another restricted quadratic Hom-Lie algebra.


title: Automatic measurement of coverage area of water-based pesticides-surfactant formulation on plant leaves using deep learning tools

abstract: A method to efficiently and quantitatively study the delivery of a pesticide-surfactant formulation in water solution over plants leaves is presented. Instead of measuring the contact angle, the surface of the leaves wet area is used as key parameter. To this goal, a deep learning model has been trained and tested, to automatically measure the surface of area wet with water solution over cucumber leaves, processing the frames of video footage. We have individuated an existing deep learning model, reported in literature for other applications, and we have applied it to this different task. We present the measurement technique, some details of the deep learning model, its training procedure and its image segmentation performance. Finally, we report the results of the wet areas surface measurement as a function of the concentration of a surfactant in the pesticide solution.


title: How do we measure trade elasticity for services?

abstract: This paper is about our attempt of identifying trade elasticities through the variations in the exchange rate, for possible applications to the case of services whose physical transactions are veiled in the trade statistics. The regression analysis to estimate the elasticity entails a situation where the explanatory variable is leaked into the error term through the latent supply equation, causing an endogeneity problem for which an instrumental variable cannot be found. Our identification strategy is to utilize the normalizing condition, which enables the supply parameter to be identified, along with the reduced-form equation of the system of demand and supply equations. We evaluate the performances of the method proposed by applying to several different tangible goods, whose benchmark trade elasticities are estimable by utilizing the information on their physical transactions.


title: Node Compass: Multilevel Tracing and Debugging of Request Executions in JavaScript-Based Web-Servers

abstract: Adequate consideration is crucial to ensure that services in a distributed application context are running satisfactorily with the resources available. Due to the asynchronous nature of tasks and the need to work with multiple layers that deliver coordinated results in a single-threaded context, analysing performance is a challenging task in event-loop-based systems. The existing performance analysis methods for environments such as Node.js rely on higher-level instrumentation but lack precision, as they cannot capture the relevant underlying application flow. As a solution, we propose a streamlined method for recovering the asynchronous execution path of requests called the Nested Bounded Context Algorithm. The proposed technique tracks the application execution flow through multiple layers and showcases it on an interactive interface for further assessment. Furthermore, we introduce the vertical span concept. This representation of a span as a multidimensional object (horizontal and vertical) with a start and end of execution, along with its sub-layers and triggered operations, enables the granular identification and diagnosis of performance issues. We proposed a new technique called the Bounded Context Tracking Algorithm for event matching and request reassembling in a multi-layer trace . The two techniques allow aligning the executions of the request in a tree-based data structure for developed visualisations. These visualisations permit performance debugging of complex performance issues in Node.js.


title: Non-Banking Sector development effect on Economic Growth. A Nighttime light data approach

abstract: This paper uses nighttime light(NTL) data to measure the nexus of the non-banking sector, particularly insurance, and economic growth in South Africa. We hypothesize that insurance sector growth positively propels economic growth due to its economic growth-supportive traits like investment protection and optimal risk mitigation. We also claim that Nighttime light data is a good economic measure than Gross domestic product (GDP). We used weighted regressions to measure the relationships between nighttime light data, GDP, and insurance sector development. We used time series South African GDP data collected from the World Bank for the period running from 2000 to 2018, and the nighttime lights data from the National Geophysical Data Centre (NGDC) in partnership with the National Oceanic and Atmospheric Administration (NOAA). From the models fitted and the reported BIC, AIC, and likelihood ratios, the insurance sector proved to have more predictive power on economic development in South Africa, and radiance light explained economic growth better than GDP and GDP/Capita. We concluded that nighttime data is a good proxy for economic growth than GDP/Capita in emerging economies like South Africa, where secondary data needs to be more robust and sometimes inflated. The findings will guide researchers and policymakers on what drives economic development and what policies to put in place. It would be interesting to extend the current study to other sectors such as micro-finances, mutual and hedge funds.


title: The Fourier-Legendre series of Bessel functions of the first kind and the summed series involving $\,_{2}F_{3}$ hypergeometric functions that arise from them

abstract: The Bessel function of the first kind $J_{N}\left(kx\right)$ is expanded in a Fourier-Legendre series, as is the modified Bessel functions of the first kind $I_{N}\left(kx\right)$. The purpose of these expansions in Legendre polynomials was not an attempt to rival established \emph{numerical methods} for calculating Bessel functions, but to provide a form for $J_{N}\left(kx\right)$ useful for \emph{analytical} work in the area of strong laser fields, where analytical integration over scattering angles is essential. Despite their primary purpose, we can easily truncate the series at 21 terms to provide 33-digit accuracy that matches IEEE extended precision in some compilers. The analytical theme is furthered by showing that infinite series of like-powered contributors (involving $\,_{2}F_{3}$ hypergeometric functions) extracted from the Fourier-Legendre series may be summed, having values that are inverse powers of the eight primes $1/\left(2^{i}3^{j}5^{k}7^{l}11^{m}13^{n}17^{o}19^{p}\right)$ multiplying powers of the coefficient $k$.


title: NutritionVerse-Real: An Open Access Manually Collected 2D Food Scene Dataset for Dietary Intake Estimation

abstract: Dietary intake estimation plays a crucial role in understanding the nutritional habits of individuals and populations, aiding in the prevention and management of diet-related health issues. Accurate estimation requires comprehensive datasets of food scenes, including images, segmentation masks, and accompanying dietary intake metadata. In this paper, we introduce NutritionVerse-Real, an open access manually collected 2D food scene dataset for dietary intake estimation with 889 images of 251 distinct dishes and 45 unique food types. The NutritionVerse-Real dataset was created by manually collecting images of food scenes in real life, measuring the weight of every ingredient and computing the associated dietary content of each dish using the ingredient weights and nutritional information from the food packaging or the Canada Nutrient File. Segmentation masks were then generated through human labelling of the images. We provide further analysis on the data diversity to highlight potential biases when using this data to develop models for dietary intake estimation. NutritionVerse-Real is publicly available at https://www.kaggle.com/datasets/nutritionverse/nutritionverse-real as part of an open initiative to accelerate machine learning for dietary sensing.


title: An annotated grain kernel image database for visual quality inspection

abstract: We present a machine vision-based database named GrainSet for the purpose of visual quality inspection of grain kernels. The database contains more than 350K single-kernel images with experts' annotations. The grain kernels used in the study consist of four types of cereal grains including wheat, maize, sorghum and rice, and were collected from over 20 regions in 5 countries. The surface information of each kernel is captured by our custom-built device equipped with high-resolution optic sensor units, and corresponding sampling information and annotations include collection location and time, morphology, physical size, weight, and Damage & Unsound grain categories provided by senior inspectors. In addition, we employed a commonly used deep learning model to provide classification results as a benchmark. We believe that our GrainSet will facilitate future research in fields such as assisting inspectors in grain quality inspections, providing guidance for grain storage and trade, and contributing to applications of smart agriculture.


title: Reinforcement Learning and Deep Stochastic Optimal Control for Final Quadratic Hedging

abstract: We consider two data driven approaches, Reinforcement Learning (RL) and Deep Trajectory-based Stochastic Optimal Control (DTSOC) for hedging a European call option without and with transaction cost according to a quadratic hedging P&L objective at maturity ("variance-optimal hedging" or "final quadratic hedging"). We study the performance of the two approaches under various market environments (modeled via the Black-Scholes and/or the log-normal SABR model) to understand their advantages and limitations. Without transaction costs and in the Black-Scholes model, both approaches match the performance of the variance-optimal Delta hedge. In the log-normal SABR model without transaction costs, they match the performance of the variance-optimal Barlett's Delta hedge. Agents trained on Black-Scholes trajectories with matching initial volatility but used on SABR trajectories match the performance of Bartlett's Delta hedge in average cost, but show substantially wider variance. To apply RL approaches to these problems, P&L at maturity is written as sum of step-wise contributions and variants of RL algorithms are implemented and used that minimize expectation of second moments of such sums.


title: Lie symmetry analysis for fractional evolution equation with $\psi$-Riemann-Liouville derivative

abstract: We present the applycation of theory of Lie group analysis with $\psi$-Riemann-Liouville fractional derivative detailing the construction of infinitesimal prolongation to obtain Lie symmetries. In additional, is addressed the invariance condition without the need to impose that the lower limit of fractional integral is fixed. We find an expression that expands the knowledge regarding the study of exact solutions for fractional differential equations. We use of the framework developed in \cite{zaky2022note} to present our understanding of the extension of $\psi$-Riemann-Liouville fractional derivative. It is demonstrate the Leibniz type rule for the derivative operator in question for built the prolongation. At last, we calculate the Lie symmetries of the generalized Burgers equation and fractional porous medium equation.


title: Learning with Chemical versus Electrical Synapses -- Does it Make a Difference?

abstract: Bio-inspired neural networks have the potential to advance our understanding of neural computation and improve the state-of-the-art of AI systems. Bio-electrical synapses directly transmit neural signals, by enabling fast current flow between neurons. In contrast, bio-chemical synapses transmit neural signals indirectly, through neurotransmitters. Prior work showed that interpretable dynamics for complex robotic control, can be achieved by using chemical synapses, within a sparse, bio-inspired architecture, called Neural Circuit Policies (NCPs). However, a comparison of these two synaptic models, within the same architecture, remains an unexplored area. In this work we aim to determine the impact of using chemical synapses compared to electrical synapses, in both sparse and all-to-all connected networks. We conduct experiments with autonomous lane-keeping through a photorealistic autonomous driving simulator to evaluate their performance under diverse conditions and in the presence of noise. The experiments highlight the substantial influence of the architectural and synaptic-model choices, respectively. Our results show that employing chemical synapses yields noticeable improvements compared to electrical synapses, and that NCPs lead to better results in both synaptic models.


title: Representation Learning in a Decomposed Encoder Design for Bio-inspired Hebbian Learning

abstract: Modern data-driven machine learning system designs exploit inductive biases on architectural structure, invariance and equivariance requirements, task specific loss functions, and computational optimization tools. Previous works have illustrated that inductive bias in the early layers of the encoder in the form of human specified quasi-invariant filters can serve as a powerful inductive bias to attain better robustness and transparency in learned classifiers. This paper explores this further in the context of representation learning with local plasticity rules i.e. bio-inspired Hebbian learning . We propose a modular framework trained with a bio-inspired variant of contrastive predictive coding (Hinge CLAPP Loss). Our framework is composed of parallel encoders each leveraging a different invariant visual descriptor as an inductive bias. We evaluate the representation learning capacity of our system in a classification scenario on image data of various difficulties (GTSRB, STL10, CODEBRIM) as well as video data (UCF101). Our findings indicate that this form of inductive bias can be beneficial in closing the gap between models with local plasticity rules and backpropagation models as well as learning more robust representations in general.


title: SAM4UDASS: When SAM Meets Unsupervised Domain Adaptive Semantic Segmentation in Intelligent Vehicles

abstract: Semantic segmentation plays a critical role in enabling intelligent vehicles to comprehend their surrounding environments. However, deep learning-based methods usually perform poorly in domain shift scenarios due to the lack of labeled data for training. Unsupervised domain adaptation (UDA) techniques have emerged to bridge the gap across different driving scenes and enhance model performance on unlabeled target environments. Although self-training UDA methods have achieved state-of-the-art results, the challenge of generating precise pseudo-labels persists. These pseudo-labels tend to favor majority classes, consequently sacrificing the performance of rare classes or small objects like traffic lights and signs. To address this challenge, we introduce SAM4UDASS, a novel approach that incorporates the Segment Anything Model (SAM) into self-training UDA methods for refining pseudo-labels. It involves Semantic-Guided Mask Labeling, which assigns semantic labels to unlabeled SAM masks using UDA pseudo-labels. Furthermore, we devise fusion strategies aimed at mitigating semantic granularity inconsistency between SAM masks and the target domain. SAM4UDASS innovatively integrate SAM with UDA for semantic segmentation in driving scenes and seamlessly complements existing self-training UDA methodologies. Extensive experiments on synthetic-to-real and normal-to-adverse driving datasets demonstrate its effectiveness. It brings more than 3% mIoU gains on GTA5-to-Cityscapes, SYNTHIA-to-Cityscapes, and Cityscapes-to-ACDC when using DAFormer and achieves SOTA when using MIC. The code will be available at https://github.com/ywher/SAM4UDASS.


title: Long cycles in linear thresholding systems

abstract: Linear thresholding systems have been used as a model of neural activation and more recently proposed as a model of gene regulation. Here we exhibit linear thresholding systems whose dynamics produce surprisingly long cycles.


title: Forking paths in financial economics

abstract: We argue that spanning large numbers of degrees of freedom in empirical analysis allows better characterizations of effects and thus improves the trustworthiness of conclusions. Our ideas are illustrated in three studies: equity premium prediction, asset pricing anomalies and risk premia estimation. In the first, we find that each additional degree of freedom in the protocol expands the average range of $t$-statistics by at least 30%. In the second, we show that resorting to forking paths instead of bootstrapping in multiple testing raises the bar of significance for anomalies: at the 5% confidence level, the threshold for bootstrapped statistics is 4.5, whereas with paths, it is at least 8.2, a bar much higher than those currently used in the literature. In our third application, we reveal the importance of particular steps in the estimation of premia. In addition, we use paths to corroborate prior findings in the three topics. We document heterogeneity in our ability to replicate prior studies: some conclusions seem robust, others do not align with the paths we were able to generate.


title: Dynamic Brain Behaviours in Stroke: A Longitudinal Investigation Based on fMRI Analysis

abstract: Background: The brain's functional network constantly adapts to external changes. However, the mechanisms underlying this dynamic adaptive behavior in stroke patients with motor injuries and its role in post-stroke motor recovery remain poorly understood. Method: This study conducted a long-term investigation involving 15 first-stroke patients. Each participant underwent five fMRI scans distributed equally over a six-month period. Using functional neuroimaging data, time-varying functional modularity in post-stroke patients was detected, and subsequently, the dynamic brain behaviors, including recruitment, integration, and flexibility, along with their longitudinal changes, were assessed. Results: Our findings reveal that stroke lesions lead to significant and enduring alterations in all three dynamic behaviors within functional brain networks. Furthermore, during the six-month recovery period, patients who exhibited good and poor recovery showed notable differences in recruitment and flexibility, indicating distinct recovery trajectories for these groups. Notably, when predicting post-stroke recovery status, whole-brain recruitment emerged as a robust and reliable feature, achieving an AUC of 85.93 Significance: Our study offers a comprehensive depiction of dynamic brain behavior in the post-ischemic-stroke brain, with a focus on longitudinal changes concurrent with functional recovery. These dynamic patterns hold promise as valuable tools for evaluating and predicting motor recovery following stroke.


title: Atmospheric noise measurements in the garden: detecting universalities in inter-spheric waiting time statistics

abstract: Lightning flashes result in an instantaneous emission of electromagnetic (EM) waves that encompass a broad spectrum of frequencies in the domain of radio waves. The signature of these impulses in the region of the very low frequency (VLF) of radio waves and bellow are called spherics. These impulsive signals traverse great distances in the waveguide between the Earth's ionosphere and its surface. Due to the abundance of lightnings the lower end of the EM spectrum is dominated by the waveforms of these emission. It is called atmospheric radio noise because of its origin. This article outlines a straightforward approach for capturing spherics activity within the VLF radio wave range. Employing data processing techniques, we pinpoint the timestamps of spherics within time series data. The distribution of inter-spheric times is analyzed across various detection threshold levels. Utilizing recordings spanning two distinct years and seasons, we replicate the established form of the inter-spheric time distribution described in the literature. Notably, we demonstrate that by rescaling the time intervals between spherics with the mean time for a specific recording and given detection threshold, the distributions collapse to a master curve. This universal pattern is accurately characterized by a single-parameter mean-scaled Gamma distribution. Additionally, we note the similarities in the distribution of inter-spheric times with patterns found in earthquake recurrence times.


title: F4D: Factorized 4D Convolutional Neural Network for Efficient Video-level Representation Learning

abstract: Recent studies have shown that video-level representation learning is crucial to the capture and understanding of the long-range temporal structure for video action recognition. Most existing 3D convolutional neural network (CNN)-based methods for video-level representation learning are clip-based and focus only on short-term motion and appearances. These CNN-based methods lack the capacity to incorporate and model the long-range spatiotemporal representation of the underlying video and ignore the long-range video-level context during training. In this study, we propose a factorized 4D CNN architecture with attention (F4D) that is capable of learning more effective, finer-grained, long-term spatiotemporal video representations. We demonstrate that the proposed F4D architecture yields significant performance improvements over the conventional 2D, and 3D CNN architectures proposed in the literature. Experiment evaluation on five action recognition benchmark datasets, i.e., Something-Something-v1, SomethingSomething-v2, Kinetics-400, UCF101, and HMDB51 demonstrate the effectiveness of the proposed F4D network architecture for video-level action recognition.


title: Leverage Staking with Liquid Staking Derivatives (LSDs): Opportunities and Risks

abstract: In the Proof of Stake (PoS) Ethereum ecosystem, users can stake ETH on Lido to receive stETH, a Liquid Staking Derivative (LSD) that represents staked ETH and accrues staking rewards. LSDs improve the liquidity of staked assets by facilitating their use in secondary markets, such as for collateralized borrowing on Aave or asset exchanges on Curve. The composability of Lido, Aave, and Curve enables an emerging strategy known as leverage staking, where users supply stETH as collateral on Aave to borrow ETH and then acquire more stETH. This can be done directly by initially staking ETH on Lido or indirectly by swapping ETH for stETH on Curve. While this iterative process enhances financial returns, it also introduces potential risks. This paper explores the opportunities and risks of leverage staking. We establish a formal framework for leverage staking with stETH and identify 442 such positions on Ethereum over 963 days. These positions represent a total volume of 537,123 ETH (877m USD). Our data reveal that the majority (81.7%) of leverage staking positions achieved an Annual Percentage Rate (APR) higher than that of conventional staking on Lido. Despite the high returns, we also recognize the risks of leverage staking. From the Terra crash incident, we understand that token devaluation can greatly impact the market. Therefore, we conduct stress tests under extreme conditions, particularly during stETH devaluations, to thoroughly evaluate the associated risks. Our simulations indicate that leverage staking can exacerbate the risk of cascading liquidations by introducing additional selling pressures from liquidation and deleveraging activities. Moreover, this strategy poses broader systemic risks as it undermines the stability of ordinary positions by intensifying their liquidations.


title: Analysis of Fractional Ordered Incommensurate Quadratic Jerk System

abstract: Fractional ordered dynamical systems (FODS) are being studied in the present due to their innate qualitative and quantitative properties and their applications in various fields. The Jerk system, which is a system involving three differential equations with quadratic complexity, arises naturally in wide ranging fields, and hence a qualitative study of solutions of jerk system and its various parameters under different conditions is important. In this article, we have studied phenomena of the Hopf bifurcation and chaos occurring in fractional ordered commensurate and incommensurate quadratic jerk system. The equilibrium points of the system are obtained and are found to be $(\pm\epsilon,0,0)$, where $\epsilon$ denotes the system parameter versus which bifurcation is analyzed. We have presented the criteria for commensurate and incommensurate quadratic jerk system to undergo a Hopf bifurcation. The value of $\epsilon$ at which system undergoes Hopf bifurcation $\epsilon_{H}$ is obtained for both commensurate as well as incommensurate system. It is known that supercritical Hopf bifurcation leads to chaos. The obtained results are verified through numerical simulations versus the fractional order $\alpha$ and parameter $\epsilon$ and the explicit range in which the system exhibits chaos is found. A number of phase portraits, bifurcation diagrams, and Lyapunov exponent diagrams are presented to affirm the obtained chaotic range of parameters.


title: General relativity in a nutshell I

abstract: Einstein's general relativity is the best available theory of gravity. In recent years, spectacular proofs of Einstein's theory have been conducted, which have aroused interest that goes far beyond the narrow circle of specialists. The aim of this work is to offer an elementary introduction to general relativity. In this first part, we introduce the geometric concepts that constitute the basis of Einstein's theory. In the second part we will use these concepts to explore the curved spacetime geometry of general relativity.


title: Digital Infrastructure for Connected and Automated Vehicles

abstract: Connected and automated vehicles (CAV) are expected to deliver a much safer, more efficient, and eco-friendlier mobility. Being an indispensable component of the future transportation, their key driving features of CAVs include not only the automated functionality but also the cooperative capability. Despite the CAVs themselves are emerging and active research areas, there is a lack of a comprehensive literature review on the digital infrastructure that enables them. In this paper, we review the requirements and benefits of digital infrastructures for the CAVs including the vehicle built-in, roadside-based, operational and planning infrastructures. We then highlight challenges and opportunities on digital infrastructure research for the CAVs. Our study sheds lights on seamless integration of digital infrastructure for safe operations of CAVs.


title: Computing the Haar state of $\mathcal{O}(SL_q(3))$ using value preserving (anti)homomorphisms

abstract: In this paper, we introduce two (anti)homomorphisms that preserve the Haar state values of monomials. Together with the modular automorphism, the three (anti)homomorphisms are used in our new algorithm to compute the Haar states of monomials on $\mathcal{O}(SL_q(3))$. Comparing with the algorithm proposed in the author's previous work \cite{lu2023}, the new algorithm reduces the linear relations used in the computation to a half.


title: Online Anomaly Detection over Live Social Video Streaming

abstract: Social video anomaly is an observation in video streams that does not conform to a common pattern of dataset's behaviour. Social video anomaly detection plays a critical role in applications from e-commerce to e-learning. Traditionally, anomaly detection techniques are applied to find anomalies in video broadcasting. However, they neglect the live social video streams which contain interactive talk, speech, or lecture with audience. In this paper, we propose a generic framework for effectively online detecting Anomalies Over social Video LIve Streaming (AOVLIS). Specifically, we propose a novel deep neural network model called Coupling Long Short-Term Memory (CLSTM) that adaptively captures the history behaviours of the presenters and audience, and their mutual interactions to predict their behaviour at next time point over streams. Then we well integrate the CLSTM with a decoder layer, and propose a new reconstruction error-based scoring function $RE_{IA}$ to calculate the anomaly score of each video segment for anomaly detection. After that, we propose a novel model update scheme that incrementally maintains CLSTM and decoder. Moreover, we design a novel upper bound and ADaptive Optimisation Strategy (ADOS) for improving the efficiency of our solution. Extensive experiments are conducted to prove the superiority of AOVLIS.


title: Le Soleil se l\`evera-t-il demain ?

abstract: Should we live every day as if it were our last? This question is legitimate when we know that Pierre-Simon de Laplace, in 1814, estimated the probability that the Sun would rise again the next day at 0.99999945. In this article, we explain in great detail the reasoning and calculations that lead to this surprising result.


title: Quantum Principle of Relativity and The Renormalizable Quantum Gravity

abstract: We develop a purely quantum theory based on the novel principle of relativity, termed the quantum principle of relativity, instead of applying the diffeomorphism invariance. We demonstrate that the essence of the principle of relativity can be naturally extended into the quantum realm, maintaining the identical structures of active and passive transformations. By employing this principle, we show that quantum gravitational effects are naturally incorporated into the renormalizable theory, with general relativity emerging in large distances. We derive graviton propagators and provide several examples grounded in this novel theory.


title: Global dynamics of a size-structured forest model

abstract: We study a size-structured model proposed in [1] C. Barril, \`A. Calsina, O. Diekmann, J. Z. Farkas, On competition through growth reduction, e-print arXiv:2303.02981, to describe the dynamics of trees growth in the forest. Our approach to the associated renewal equation is rather different from the methods in [1] and is based on ideas developed in [2] F. Herrera, S. Trofimchuk, Dynamics of one-dimensional maps and Gurtin-MacCamy's population model. Part I: asymptotically constant solutions, Ukrainian Math. J., (in Memory of O. Sharkovsky), 75 (2023), 1635-1651, https://doi.org/10.3842/umzh.v75i12.7678. Assuming relatively weak restrictions on the reproduction, death and growth rates $\beta, \mu, g$, we establish the permanence properties of the semiflow $\frak F^t$ generated by the renewal equation and prove that it possesses a compact global attractor of points $\mathcal A$. Next we show that the opposite types of monotonicity of $\beta, g$ assure that $\frak F^t$ is also monotone and that in this case $\mathcal A$ coincides with a unique asymptotically stable equilibrium attracting neighbourhoods of compact sets with non-zero initial data.


title: MATE-Pred: Multimodal Attention-based TCR-Epitope interaction Predictor

abstract: An accurate binding affinity prediction between T-cell receptors and epitopes contributes decisively to develop successful immunotherapy strategies. Some state-of-the-art computational methods implement deep learning techniques by integrating evolutionary features to convert the amino acid residues of cell receptors and epitope sequences into numerical values, while some other methods employ pre-trained language models to summarize the embedding vectors at the amino acid residue level to obtain sequence-wise representations. Here, we propose a highly reliable novel method, MATE-Pred, that performs multi-modal attention-based prediction of T-cell receptors and epitopes binding affinity. The MATE-Pred is compared and benchmarked with other deep learning models that leverage multi-modal representations of T-cell receptors and epitopes. In the proposed method, the textual representation of proteins is embedded with a pre-trained bi-directional encoder model and combined with two additional modalities: a) a comprehensive set of selected physicochemical properties; b) predicted contact maps that estimate the 3D distances between amino acid residues in the sequences. The MATE-Pred demonstrates the potential of multi-modal model in achieving state-of-the-art performance (+8.4\% MCC, +5.5\% AUC compared to baselines) and efficiently capturing contextual, physicochemical, and structural information from amino acid residues. The performance of MATE-Pred projects its potential application in various drug discovery regimes.


title: Hermite-Hadamard type inequalities by using Newton-Cotes quadrature formulas

abstract: A convex function $f:[a,b]\to\mathbb{R}$ satisfies the so-called Hermite-Hadamard inequality $$ f\left(\frac{a+b}{2}\right)\leq \frac{1}{b-a}\int_a^{b}f(t)dt\leq \frac{f(a)+f(b)}{2}. $$ Motivated by the above estimates, in this paper we consider approximately monotone and convex functions, and give upper and lower bounds to the numerical integral mean, i.e., to $\frac1{b-a}\mathcal{I}_{n}(f)$, where $\mathcal{I}_{n}(f)$ denotes some of the most popular Newton-Cotes quadrature formulas.


title: Algebraic structure of the Gaussian-PDMF space and applications on fuzzy equations

abstract: In this paper, we extend the research presented in [Wang and Zheng, Fuzzy Sets and Systems, p108581, 2023] by establishing the algebraic structure of the Gaussian Probability Density Membership Function (Gaussian-PDMF) space. We consider fixed objective and subjective entities, denoted as $(h,p)$, and provide the explicit form of the membership function. Consequently, every fuzzy number with the membership function in $X_{h,p}(\mathbb{R})$, denoted as $\tilde{x}$, can be uniquely identified by a vector $\langle x; d^-, d^+, \mu^-,\mu^+\rangle$. Here, $x\in \mathbb{R}$ represents the "leading factor" of the fuzzy number $\tilde{x}$ with a membership degree equal to $1$. The parameters $d^-$ (left side) and $d^+$ (right side) denote the lengths of the compact support, while $\mu^-$ (left side) and $\mu^+$ (right side) represent the shapes. We introduce five operators: addition, subtraction, multiplication, scalar multiplication, and division. We demonstrate that, based on our definitions, the Gaussian-PDMF space exhibits a well-defined algebraic structure. For instance, $X_{h,p}(\mathbb{R})$ is a vector space over $\mathbb{R}$, featuring a subspace that forms a division ring, allowing for the representation of fuzzy polynomials, among other properties. We provide several examples to illustrate our theoretical results.


title: Introduction to probability and statistics: a computational framework of randomness

abstract: This text presents an unified approach of probability and statistics in the pursuit of understanding and computation of randomness in engineering or physical or social system with prediction with generalizability. Starting from elementary probability and theory of distributions, the material progresses towards conceptual and advances in prediction and generalization in statistical models and large sample theory. We also pay special attention to unified derivation approach and one-shot proof of each and every probabilistic concept. Our presentation of intuitive and computation framework of conditional distribution and probability are strongly influenced by unified patterns of linear models for regression and for classification. The text ends with a future note on the unified approximation of the linear models, the generalized linear models and the discovery models to neural networks and a summarized ML system.


title: Wake-Sleep Consolidated Learning

abstract: We propose Wake-Sleep Consolidated Learning (WSCL), a learning strategy leveraging Complementary Learning System theory and the wake-sleep phases of the human brain to improve the performance of deep neural networks for visual classification tasks in continual learning settings. Our method learns continually via the synchronization between distinct wake and sleep phases. During the wake phase, the model is exposed to sensory input and adapts its representations, ensuring stability through a dynamic parameter freezing mechanism and storing episodic memories in a short-term temporary memory (similarly to what happens in the hippocampus). During the sleep phase, the training process is split into NREM and REM stages. In the NREM stage, the model's synaptic weights are consolidated using replayed samples from the short-term and long-term memory and the synaptic plasticity mechanism is activated, strengthening important connections and weakening unimportant ones. In the REM stage, the model is exposed to previously-unseen realistic visual sensory experience, and the dreaming process is activated, which enables the model to explore the potential feature space, thus preparing synapses to future knowledge. We evaluate the effectiveness of our approach on three benchmark datasets: CIFAR-10, Tiny-ImageNet and FG-ImageNet. In all cases, our method outperforms the baselines and prior work, yielding a significant performance gain on continual visual classification tasks. Furthermore, we demonstrate the usefulness of all processing stages and the importance of dreaming to enable positive forward transfer.


title: Towards Practical Cell-Free 6G Network Deployments: An Open-Source End-to-End Ray Tracing Simulator

abstract: The advent of 6G wireless communication marks a transformative era in technological connectivity, bringing forth challenges and opportunities alike. This paper unveils an innovative, open-source simulator, meticulously crafted for cell-free 6G wireless networks. This simulator is not just a tool but a gateway to the future, blending cutting-edge channel models with the simulation of both physical propagation effects and intricate system-level protocols. It stands at the forefront of technological advancement by integrating LIS and MIMO technologies, harnessing the power of the Unity game engine for efficient ray-tracing and GPU-accelerated computations. The unparalleled flexibility in scenario configuration, coupled with its unique ability to dynamically simulate interactions across network layers, establishes this simulator as an indispensable asset in pioneering &G systems' research and development.


title: Conditional Flood Fill Method in Logic Synthesis

abstract: In the field of Electronic Design Automation (EDA), logic synthesis plays a pivotal role in optimizing hardware resources. Traditional logic synthesis algorithms, such as the Quine-McCluskey method, face challenges in scalability and efficiency, particularly for higher-dimension problems. This paper introduces a novel heuristic algorithm based on Conditional Flood Fill Method aimed at addressing these limitations. Our method employs count-based adjacent element handling and introduces nine new theorems to guide the logic synthesis process. Experimental results validate the efficacy of our approach, showing significant improvements in computational efficiency and scalability compared to existing algorithms. The algorithm holds potential for future advancements in circuit development and Boolean function optimization.


title: Validation and Comparison of Non-Stationary Cognitive Models: A Diffusion Model Application

abstract: Cognitive processes undergo various fluctuations and transient states across different temporal scales. Superstatistics are emerging as a flexible framework for incorporating such non-stationary dynamics into existing cognitive model classes. In this work, we provide the first experimental validation of superstatistics and formal comparison of four non-stationary diffusion decision models in a specifically designed perceptual decision-making task. Task difficulty and speed-accuracy trade-off were systematically manipulated to induce expected changes in model parameters. To validate our models, we assess whether the inferred parameter trajectories align with the patterns and sequences of the experimental manipulations. To address computational challenges, we present novel deep learning techniques for amortized Bayesian estimation and comparison of models with time-varying parameters. Our findings indicate that transition models incorporating both gradual and abrupt parameter shifts provide the best fit to the empirical data. Moreover, we find that the inferred parameter trajectories closely mirror the sequence of experimental manipulations. Posterior re-simulations further underscore the ability of the models to faithfully reproduce critical data patterns. Accordingly, our results suggest that the inferred non-stationary dynamics may reflect actual changes in the targeted psychological constructs. We argue that our initial experimental validation paves the way for the widespread application of superstatistics in cognitive modeling and beyond.


title: Predicting and Interpreting Energy Barriers of Metallic Glasses with Graph Neural Networks

abstract: Metallic Glasses (MGs) are widely used materials that are stronger than steel while being shapeable as plastic. While understanding the structure-property relationship of MGs remains a challenge in materials science, studying their energy barriers (EBs) as an intermediary step shows promise. In this work, we utilize Graph Neural Networks (GNNs) to model MGs and study EBs. We contribute a new dataset for EB prediction and a novel Symmetrized GNN (SymGNN) model that is E(3)-invariant in expectation. SymGNN handles invariance by aggregating over orthogonal transformations of the graph structure. When applied to EB prediction, SymGNN are more accurate than molecular dynamics (MD) local-sampling methods and other machine-learning models. Compared to precise MD simulations, SymGNN reduces the inference time on new MGs from roughly 41 days to less than one second. We apply explanation algorithms to reveal the relationship between structures and EBs. The structures that we identify through explanations match the medium-range order (MRO) hypothesis and possess unique topological properties. Our work enables effective prediction and interpretation of MG EBs, bolstering material science research.


title: Monostatic imaging of an extended target with MCMC sampling

abstract: We consider the imaging of a planar extended target from far-field data under a monostatic measurement configuration, in which the data is measured by a single moving transducer, as frequently encountered in practical application. In this paper, we develop a Bayesian approach to recover the shape of the extended target with MCMC sampling, where a new shape basis selection is proposed based on the shape derivative analysis for the measurement data. In order to optimize the center and radius of the initial disk, we use the monostatic sampling method for the center and the explicit scattered field expression for disks for the radius. Numerical simulations are presented to validate the proposed method.


title: Immature Green Apple Detection and Sizing in Commercial Orchards using YOLOv8 and Shape Fitting Techniques

abstract: Detecting and estimating size of apples during the early stages of growth is crucial for predicting yield, pest management, and making informed decisions related to crop-load management, harvest and post-harvest logistics, and marketing. Traditional fruit size measurement methods are laborious and timeconsuming. This study employs the state-of-the-art YOLOv8 object detection and instance segmentation algorithm in conjunction with geometric shape fitting techniques on 3D point cloud data to accurately determine the size of immature green apples (or fruitlet) in a commercial orchard environment. The methodology utilized two RGB-D sensors: Intel RealSense D435i and Microsoft Azure Kinect DK. Notably, the YOLOv8 instance segmentation models exhibited proficiency in immature green apple detection, with the YOLOv8m-seg model achieving the highest AP@0.5 and AP@0.75 scores of 0.94 and 0.91, respectively. Using the ellipsoid fitting technique on images from the Azure Kinect, we achieved an RMSE of 2.35 mm, MAE of 1.66 mm, MAPE of 6.15 mm, and an R-squared value of 0.9 in estimating the size of apple fruitlets. Challenges such as partial occlusion caused some error in accurately delineating and sizing green apples using the YOLOv8-based segmentation technique, particularly in fruit clusters. In a comparison with 102 outdoor samples, the size estimation technique performed better on the images acquired with Microsoft Azure Kinect than the same with Intel Realsense D435i. This superiority is evident from the metrics: the RMSE values (2.35 mm for Azure Kinect vs. 9.65 mm for Realsense D435i), MAE values (1.66 mm for Azure Kinect vs. 7.8 mm for Realsense D435i), and the R-squared values (0.9 for Azure Kinect vs. 0.77 for Realsense D435i).


title: Pedestrian models with congestion effects

abstract: We study the validity of the dissipative Aw-Rascle system as a macroscopic model for pedestrian dynamics. The model uses a congestion term (a singular diffusion term) to enforce capacity constraints in the crowd density while inducing a steering behaviour. Furthermore, we introduce a semi-implicit, structure-preserving, and asymptotic-preserving numerical scheme which can handle the numerical solution of the model efficiently. We perform the first numerical simulations of the dissipative Aw-Rascle system in one and two dimensions. We demonstrate the efficiency of the scheme in solving an array of numerical experiments, and we validate the model, ultimately showing that it correctly captures the fundamental diagram of pedestrian flow.


title: The Conquest of Quantum Genetic Algorithms: The Adventure to Cross the Valley of Death

abstract: In recent years, the emergence of the first quantum computers at a time when AI is undergoing a fruitful era has led many AI researchers to be tempted into adapting their algorithms to run on a quantum computer. However, in many cases the initial enthusiasm has ended in frustration, since the features and principles underlying quantum computing are very different from traditional computers. In this paper, we present a discussion of the difficulties arising when designing a quantum version of an evolutionary algorithm based on Darwin's evolutionary mechanism, the so-called genetic algorithms. The paper includes the code in both Python and QISKIT of the quantum version of one of these evolutionary algorithms allowing the reader to experience the setbacks arising when translating a classical algorithm to its quantum version. The algorithm studied in this paper, termed RQGA (Reduced Quantum Genetic Algorithm), has been chosen as an example that clearly shows these difficulties, which are common to other AI algorithms.


title: Synergizing Quality-Diversity with Descriptor-Conditioned Reinforcement Learning

abstract: A fundamental trait of intelligence involves finding novel and creative solutions to address a given challenge or to adapt to unforeseen situations. Reflecting this, Quality-Diversity optimization is a family of Evolutionary Algorithms, that generates collections of both diverse and high-performing solutions. Among these, MAP-Elites is a prominent example, that has been successfully applied to a variety of domains, including evolutionary robotics. However, MAP-Elites performs a divergent search with random mutations originating from Genetic Algorithms, and thus, is limited to evolving populations of low-dimensional solutions. PGA-MAP-Elites overcomes this limitation using a gradient-based variation operator inspired by deep reinforcement learning which enables the evolution of large neural networks. Although high-performing in many environments, PGA-MAP-Elites fails on several tasks where the convergent search of the gradient-based variation operator hinders diversity. In this work, we present three contributions: (1) we enhance the Policy Gradient variation operator with a descriptor-conditioned critic that reconciles diversity search with gradient-based methods, (2) we leverage the actor-critic training to learn a descriptor-conditioned policy at no additional cost, distilling the knowledge of the population into one single versatile policy that can execute a diversity of behaviors, (3) we exploit the descriptor-conditioned actor by injecting it in the population, despite network architecture differences. Our method, DCG-MAP-Elites, achieves equal or higher QD score and coverage compared to all baselines on seven challenging continuous control locomotion tasks.


title: Creating Visual Effects with Neural Radiance Fields

abstract: We present a pipeline for integrating NeRFs into traditional compositing VFX pipelines using Nerfstudio, an open-source framework for training and rendering NeRFs. Our approach involves using Blender, a widely used open-source 3D creation software, to align camera paths and composite NeRF renders with meshes and other NeRFs, allowing for seamless integration of NeRFs into traditional VFX pipelines. Our NeRF Blender add-on allows for more controlled camera trajectories of photorealistic scenes, compositing meshes and other environmental effects with NeRFs, and compositing multiple NeRFs in a single scene.This approach of generating NeRF aligned camera paths can be adapted to other 3D tool sets and workflows, enabling a more seamless integration of NeRFs into visual effects and film production. Documentation can be found here: https://docs.nerf.studio/extensions/blender_addon.html


title: Resilient Path Planning for UAVs in Data Collection under Adversarial Attacks

abstract: In this paper, we investigate jamming-resilient UAV path planning strategies for data collection in Internet of Things (IoT) networks, in which the typical UAV can learn the optimal trajectory to elude such jamming attacks. Specifically, the typical UAV is required to collect data from multiple distributed IoT nodes under collision avoidance, mission completion deadline, and kinematic constraints in the presence of jamming attacks. We first design a fixed ground jammer with continuous jamming attack and periodical jamming attack strategies to jam the link between the typical UAV and IoT nodes. Defensive strategies involving a reinforcement learning (RL) based virtual jammer and the adoption of higher SINR thresholds are proposed to counteract against such attacks. Secondly, we design an intelligent UAV jammer, which utilizes the RL algorithm to choose actions based on its observation. Then, an intelligent UAV anti-jamming strategy is constructed to deal with such attacks, and the optimal trajectory of the typical UAV is obtained via dueling double deep Q-network (D3QN). Simulation results show that both non-intelligent and intelligent jamming attacks have significant influence on the UAV's performance, and the proposed defense strategies can recover the performance close to that in no-jammer scenarios.


title: Knuth's non-associative "group" on ${\mathcal P}(\mathbb{N})$

abstract: Donald Knuth introduced in The Art of Computer Programming (Vol 4a) a fast approximation to the addition of integers (given in binary) in terms of bit-wise operations by $a + b \; \approx \; a \oplus b \oplus ((a\land b) \ll 1).$ Generalizing this to infinite bit-strings we get a binary operation on ${\mathcal P}(\mathbb{N})$, the power-set of $\mathbb{N}$ (which we identify with the collection of infinite bit-strings). We show that this operation is ``group-like'' in that it has a neutral element, inverses, but it is not associative. There are a lot of questions left, which the author has not been able to answer.


title: MLCommons Cloud Masking Benchmark with Early Stopping

abstract: In this paper, we report on work performed for the MLCommons Science Working Group on the cloud masking benchmark. MLCommons is a consortium that develops and maintains several scientific benchmarks that aim to benefit developments in AI. The benchmarks are conducted on the High Performance Computing (HPC) Clusters of New York University and University of Virginia, as well as a commodity desktop. We provide a description of the cloud masking benchmark, as well as a summary of our submission to MLCommons on the benchmark experiment we conducted. It includes a modification to the reference implementation of the cloud masking benchmark enabling early stopping. This benchmark is executed on the NYU HPC through a custom batch script that runs the various experiments through the batch queuing system while allowing for variation on the number of epochs trained. Our submission includes the modified code, a custom batch script to modify epochs, documentation, and the benchmark results. We report the highest accuracy (scientific metric) and the average time taken (performance metric) for training and inference that was achieved on NYU HPC Greene. We also provide a comparison of the compute capabilities between different systems by running the benchmark for one epoch. Our submission can be found in a Globus repository that is accessible to MLCommons Science Working Group.


title: Collaborative Inference via Dynamic Composition of Tiny AI Accelerators on MCUs

abstract: The advent of tiny AI accelerators opens opportunities for deep neural network deployment at the extreme edge, offering reduced latency, lower power cost, and improved privacy in on-device ML inference. Despite these advancements, challenges persist due to inherent limitations of these accelerators, such as restricted onboard memory and single-device focus. This paper introduces Synergy, a system that dynamically composes tiny AI accelerators for multi-tenant models, effectively addressing tinyML's critical challenges for the increasing demand for on-device AI. A key feature of Synergy is its virtual computing space, providing a unified, virtualized view of resources and enabling efficient task mapping to physical devices. Synergy's runtime orchestration module ensures optimal inference across dynamic and heterogeneous accelerators. Our evaluations with 7 baselines and 8 models demonstrate that Synergy improves throughput by an average of 8.0X compared to baselines.


title: The Enigmas of Fluctuations of the Universal Quantum Fields

abstract: The primary ingredients of reality are the universal quantum fields, which fluctuate persistently, spontaneously, and randomly. The general perception of the scientific community is that these quantum fluctuations are due to the uncertainty principle. Here, we present cogent arguments to show that the uncertainty principle is a consequence of the quantum fluctuations, but not their cause. This poses a conspicuous enigma as to how the universal fields remain immutable with an expectation value so accurate that it leads to experimental results, which are precise to one part in a trillion. We discuss some reasonable possibilities in the absence of a satisfactory solution to this enigma.


title: One-Step Diffusion Distillation via Deep Equilibrium Models

abstract: Diffusion models excel at producing high-quality samples but naively require hundreds of iterations, prompting multiple attempts to distill the generation process into a faster network. However, many existing approaches suffer from a variety of challenges: the process for distillation training can be complex, often requiring multiple training stages, and the resulting models perform poorly when utilized in single-step generative applications. In this paper, we introduce a simple yet effective means of distilling diffusion models directly from initial noise to the resulting image. Of particular importance to our approach is to leverage a new Deep Equilibrium (DEQ) model as the distilled architecture: the Generative Equilibrium Transformer (GET). Our method enables fully offline training with just noise/image pairs from the diffusion model while achieving superior performance compared to existing one-step methods on comparable training budgets. We demonstrate that the DEQ architecture is crucial to this capability, as GET matches a $5\times$ larger ViT in terms of FID scores while striking a critical balance of computational cost and image quality. Code, checkpoints, and datasets are available.


title: Typification of Driver Models Using Clustering Methods

abstract: The rapid development of automated driving systems in recent years has led to improvements in road safety and travel comfort. One typical function of these systems is Lane Keep Assist, which generally does not take human driving preferences into account. In our previous work, we have demonstrated that it is possible to implement a Lane Keep Assist function that is appropriate to human preferences using a trajectory planning algorithm based on a linear driving model. In our current work, we investigated how to separate the driving styles of individual drivers. We assumed that there are three driving styles: sporty, neutral and defensive. To prove these relations, clustering methods were applied to previously recorded measurements . Simulations with parameters describing the average behaviour of the classes (re-simulated with clustered types) showed that the resulting paths successfully classified drivers, that the 3 classes are distinct in their behaviour and that our model reproduces these behaviours.


title: Tighter sum uncertainty relations via $(\alpha,\beta,\gamma)$ weighted Wigner-Yanase-Dyson skew information

abstract: We establish tighter uncertainty relations for arbitrary finite observables via $(\alpha,\beta,\gamma)$ weighted Wigner-Yanase-Dyson ($(\alpha,\beta,\gamma)$WWYD) skew information. The results are also applicable to the $(\alpha,\gamma)$ weighted Wigner-Yanase-Dyson ($(\alpha,\gamma)$WWYD) skew information and the weighted Wigner-Yanase-Dyson (WWYD) skew information. We also present tighter lower bounds of quantum channels and unitary channels via $(\alpha,\beta,\gamma)$ modified weighted Wigner-Yanase-Dyson ($(\alpha,\beta,\gamma)$MWWYD) skew information. Detailed examples are provided to illustrate tightness of our uncertainty relations.


title: Prediction problem for continuous time stochastic processes with periodically correlated increments observed with noise

abstract: We propose solution of the problem of the mean square optimal estimation of linear functionals which depend on the unobserved values of a continuous time stochastic process with periodically correlated increments based on observations of this process with periodically stationary noise. To solve the problem, we transform the processes to the sequences of stochastic functions which form an infinite dimensional vector stationary sequences. In the case of known spectral densities of these sequences, we obtain formulas for calculating values of the mean square errors and the spectral characteristics of the optimal estimates of the functionals. Formulas determining the least favorable spectral densities and the minimax (robust) spectral characteristics of the optimal linear estimates of functionals are derived in the case where the sets of admissible spectral densities are given.


title: Exploratory Driving Performance and Car-Following Modeling for Autonomous Shuttles Based on Field Data

abstract: Autonomous shuttles (AS) operate in several cities and have shown potential to improve the public transport network. However, there is no car following model that is based on field data and allows decision-makers to assess and plan for AS operations. To fill this gap, this study collected field data from AS, analyzed their driving performance, and suggested changes in the AS trajectory model to improve passenger comfort. A sample was collected with more than 4000 seconds of AS following a conventional car. The sample contained GPS positions from both AS and conventional vehicles. Latitude and longitude positions were used to calculate the speed, acceleration, and jerk of the leader and follower. The data analyses indicated that AS have higher jerk values that may impact the passengers comfort. Several existing models were evaluated, and the researchers concluded that the calibrated ACC model resulted in lower errors for AS spacing and speed. The results of the calibration indicate that the AS has lower peak acceleration and higher deceleration than the parameters that were calibrated for autonomous vehicle models in other research


title: Fuzzy Volterra Integral Equation with Piecewise Continuous Kernel: Theory and Numerical Solution

abstract: This study aims to discuss the existence and uniqueness of solution of fuzzy Volterra integral equation with piecewise continuous kernel. Such problems appears in many balance problems for hereditary dynamic systems, e.g. in electric load leveling. The method of successive approximations is applied and the main theorems are proved based on the method. Some examples are discussed and the results are presented for different values of $\mu$ by plotting several graphs.


title: Automated Design Appraisal: Estimating Real Estate Price Growth and Value at Risk due to Local Development

abstract: Financial criteria in architectural design evaluation are limited to cost performance. Here, I introduce a method, Automated Design Appraisal (ADA), to predict the market price of a generated building design concept within a local urban context. Integrating ADA with 3D building performance simulations enables financial impact assessment that exceeds the spatial resolution of previous work. Within an integrated impact assessment, ADA measures the direct and localized effect of urban development. To demonstrate its practical utility, I study local devaluation risk due to nearby development associated with changes to visual landscape quality. The results shed light on the relationship between amenities and property value, identifying clusters of properties physically exposed or financially sensitive to local land-use change. Beyond its application as a financial sensitivity tool, ADA serves as a blueprint for architectural design optimization procedures, in which economic performance is evaluated based on learned preferences derived from financial market data.


title: Clifford-algebraic formulation of nonlinear conformal transformations in electrodynamics

abstract: We derive a set of Clifford-algebraic formulas for two major nonlinear conformal transformations of the physical quantities related to Maxwell's equations. The superiority of these formulas over their vector-tensorial counterparts are demonstrated through three illustrative examples.


title: The "Pac-Man'' Gripper: Tactile Sensing and Grasping through Thin-Shell Buckling

abstract: Soft and lightweight grippers have greatly enhanced the performance of robotic manipulators in handling complex objects with varying shape, texture, and stiffness. However, the combination of universal grasping with passive sensing capabilities still presents challenges. To overcome this limitation, we introduce a fluidic soft gripper, named the ``Pac-Man'' gripper, based on the buckling of soft, thin hemispherical shells. Leveraging a single fluidic pressure input, the soft gripper can encapsulate slippery and delicate objects while passively providing information on this physical interaction. Guided by analytical, numerical, and experimental tools, we explore the novel grasping principle of this mechanics-based soft gripper. First, we characterize the buckling behavior of a free hemisphere as a function of its geometric parameters. Inspired by the free hemisphere's two-lobe mode shape ideal for grasping purposes, we demonstrate that the gripper can perform dexterous manipulation and gentle gripping of fragile objects in confined environments. Last, we prove the soft gripper's embedded capability of detecting contact, grasping, and release conditions during the interaction with an unknown object. This simple buckling-based soft gripper opens new avenues for the design of adaptive gripper morphologies with applications ranging from medical and agricultural robotics to space and underwater exploration.


title: Long-term temporal-scales of hydrosphere changes observed by GPS over Europe: a comparison with GRACE and ENSO

abstract: Hydrogeodesy can benefit greatly from the use of Global Positioning System (GPS) displacements to analyse local changes in the hydrosphere, which the commonly used Gravity Recovery and Climate Experiment (GRACE) mission is unable to provide due to coarse spatial resolution. Hydrosphere changes recorded by GPS are unfortunately hidden among the other signals to which the system is also sensitive so that the sensitivity of GPS to changes in the hydrosphere on temporal-scales from pluri-annual to decadal is questionable. We focus on hydrosphere signatures present on these long-term temporal-scales as observed by GPS through the vertical displacement time series (DTS) of 122 permanent stations over Europe and compare them to the DTS derived from GRACE for GPS locations. Our methodology is based on the weighted Savitzky-Golay (S-G) filter, an underestimated filter in the field of geodetic time series analysis. We show that the correspondence between GPS and GRACE on long-term temporal-scales is generally strong, but decreases for coastal regions and regions where the coarse gridding of GRACE does not capture local hydrosphere effects. Further, the negative correlation with El Ni\~no Southern Oscillations (ENSO) is confirmed for Europe.


title: Deep Pulse-Coupled Neural Networks

abstract: Spiking Neural Networks (SNNs) capture the information processing mechanism of the brain by taking advantage of spiking neurons, such as the Leaky Integrate-and-Fire (LIF) model neuron, which incorporates temporal dynamics and transmits information via discrete and asynchronous spikes. However, the simplified biological properties of LIF ignore the neuronal coupling and dendritic structure of real neurons, which limits the spatio-temporal dynamics of neurons and thus reduce the expressive power of the resulting SNNs. In this work, we leverage a more biologically plausible neural model with complex dynamics, i.e., a pulse-coupled neural network (PCNN), to improve the expressiveness and recognition performance of SNNs for vision tasks. The PCNN is a type of cortical model capable of emulating the complex neuronal activities in the primary visual cortex. We construct deep pulse-coupled neural networks (DPCNNs) by replacing commonly used LIF neurons in SNNs with PCNN neurons. The intra-coupling in existing PCNN models limits the coupling between neurons only within channels. To address this limitation, we propose inter-channel coupling, which allows neurons in different feature maps to interact with each other. Experimental results show that inter-channel coupling can efficiently boost performance with fewer neurons, synapses, and less training time compared to widening the networks. For instance, compared to the LIF-based SNN with wide VGG9, DPCNN with VGG9 uses only 50%, 53%, and 73% of neurons, synapses, and training time, respectively. Furthermore, we propose receptive field and time dependent batch normalization (RFTD-BN) to speed up the convergence and performance of DPCNNs.


title: Schatten index of the operator via the real component of its inverse

abstract: In this paper we study spectral properties of non-selfadjoint operators with the discrete spectrum. The main challenge is to represent a complete description of belonging to the Schatten class through the properties of the Hermitian real component. The method of estimating the singular values is elaborated by virtue of the established asymptotic formulas. The latter fundamental result is advantageous since many theoretical statements based upon it, one of them is a concept on the root vectors series expansion which leads to a wide spectrum of applications in the theory of evolution equations. In this regard the evolution equations of fractional order with the operator in the term not containing the time variable are involved. The concrete well-known operators are considered and the advantage of the represented method is convexly shown.


title: Towards Near-Field 3D Spot Beamfocusing: Possibilities, Challenges, and Use-cases

abstract: Spot beamfocusing (SBF) is the process of focusing the signal power in a small spot-like region in the 3D space, which can be either hard-tuned (HT) using traditional tools like lenses and mirrors or electronically reconfigured (ER) using modern large-scale intelligent surface phased arrays. ER-SBF can be a key enabling technology (KET) for the next-generation 6G wireless networks offering benefits to many future wireless application areas such as wireless communication and security, mid-range wireless chargers, medical and health, physics, etc. Although near-field HT-SBF and ER-beamfocusing have been studied in the literature and applied in the industry, there is no comprehensive study of different aspects of ER-SBF and its future applications, especially for nonoptical (mmWave, sub-THz, and THz) electromagnetic waves in the next generation wireless technology, which is the aim of this paper. The theoretical concepts behind ER-SBF, different antenna technologies for implementing ER-SBF, employing machine learning (ML)-based schemes for enabling channel-state-information (CSI)-independent ER-SBF, and different practical application areas that can benefit from ER-SBF will be explored.


title: An Efficient Dynamic Transaction Storage Mechanism for Sustainable High Throughput Bitcoin

abstract: As coin-based rewards dwindle, transaction fees play an important role as mining incentives in Bitcoin. In this paper, we propose a novel mechanism called Efficient Dynamic Transaction Storage (EDTS) for dynamically allocating transactions among blocks to achieve efficient storage utilization. By leveraging a combination of Cuckoo Filter and Dynamic Transaction Storage (DTS) strategies, EDTS is able to improve the scalability while remaining sustainable even after the Bitcoin enters a transaction-fee regime. In addition to preventing deviant mining behaviors under the transaction-fee regime, EDTS can also provide differentiated transmission priorities based on transaction fees while allowing the investors to engage in pledging more transaction fees. In EDTS, we applied the multi-objective optimization algorithm U-NSGA-III to find the best DTS strategy and its corresponding attributes. Experimental results show that the EDTS mechanism together with the optimized DTS strategy can achieve a throughput of 325.3 TPS. The experimental results reveal that the scalability improvement of EDTS is superior to the performance of Bitcoin NG, which is the best known on-chain scaling solution, while maintaining the sustainability under the transaction-fee regime.


title: Digital Twins for Autonomous Driving: A Comprehensive Implementation and Demonstration

abstract: The concept of a digital twin (DT) plays a pivotal role in the ongoing digital transformation and has achieved significant strides for various wireless applications in recent years. In particular, the field of autonomous vehicles is a domain that is ripe for exploiting the concept of DT. Nevertheless, there are many challenges that include holistic consideration and integration of hardware, software, communication methods, and collaboration of edge/cloud computing. In this paper, an end-to-end (E2E) real-world smart mobility DT is designed and implemented for the purpose of autonomous driving. The proposed system utilizes roadside units (RSUs) and edge computing to capture real-world traffic information, which is then processed in the cloud to create a DT model. This DT model is then exploited to enable route planning services for the autonomous vehicle to avoid heavy traffic. Real-world experimental results show that the system reliability can reach 99.53% while achieving a latency that is 3.36% below the 3GPP recommended value of 100 ms for autonomous driving. These results clearly validate the effectiveness of the system according to practical 3GPP standards for sensor and state map sharing (SSMS) and information sharing.


title: Smart Mobility Digital Twin for Automated Driving: Design and Proof-of-Concept

abstract: During the past decade, smart mobility and intelligent vehicles have attracted increasing attention, because they promise to create a highly efficient and safe transportation system in the future. Meanwhile, digital twin, as an emerging technology, will play an important role in automated driving and intelligent transportation systems. This technology is applied in this paper to design a platform for smart mobility, providing large-scale route planning services. Utilizing sensing technologies and cloud/edge computing, we build a digital twin system model that reflects the static and dynamic objects from the real world in real time. With the smart mobility platform, we realize traffic monitoring and route planning through cooperative environment perception to help automated vehicles circumvent jams. A proof-of-concept test with a real vehicle in real traffic is conducted to validate the functions and the delay performance of the proposed platform.


title: SAiD: Speech-driven Blendshape Facial Animation with Diffusion

abstract: Speech-driven 3D facial animation is challenging due to the scarcity of large-scale visual-audio datasets despite extensive research. Most prior works, typically focused on learning regression models on a small dataset using the method of least squares, encounter difficulties generating diverse lip movements from speech and require substantial effort in refining the generated outputs. To address these issues, we propose a speech-driven 3D facial animation with a diffusion model (SAiD), a lightweight Transformer-based U-Net with a cross-modality alignment bias between audio and visual to enhance lip synchronization. Moreover, we introduce BlendVOCA, a benchmark dataset of pairs of speech audio and parameters of a blendshape facial model, to address the scarcity of public resources. Our experimental results demonstrate that the proposed approach achieves comparable or superior performance in lip synchronization to baselines, ensures more diverse lip movements, and streamlines the animation editing process.


title: Convergence of double step scheme for a class of parabolic Clarke subdifferential inclusions

abstract: In this paper we deal with a first order evolution inclusion involving a multivalued term generated by a Clarke subdifferential of a locally Lipschitz potential. For this problem we construct a double step time-semidiscrete approximation, known as the Rothe scheme. We study a sequence of solutions of the semidiscrete approximate problems and provide its weak convergence to a limit element that is a solution of the original problem.


title: An approach to determining the existence of a limit distribution of additive arithmetic functions

abstract: An approach will be proposed to determine the existence of a limit distribution of additive arithmetic functions in this work. It is based on assertions that will be proven in this work and on the properties of Dirichlet convolution and M\"obius inversion. Based on this approach, formulas will be obtained for finding the mean and variance for the limit distribution of additive arithmetic functions. Examples of this approach to proving the existence of a limit distribution of additive arithmetic functions and finding the mean value and variance for the limit distribution of additive arithmetic functions are considered.


title: End-To-End Planning of Autonomous Driving in Industry and Academia: 2022-2023

abstract: This paper aims to provide a quick review of the methods including the technologies in detail that are currently reported in industry and academia. Specifically, this paper reviews the end-to-end planning, including Tesla FSD V12, Momenta 2023, Horizon Robotics 2023, Motional RoboTaxi 2022, Woven Planet (Toyota): Urban Driver, and Nvidia. In addition, we review the state-of-the-art academic studies that investigate end-to-end planning of autonomous driving. This paper provides readers with a concise structure and fast learning of state-of-the-art end-to-end planning for 2022-2023. This article provides a meaningful overview as introductory material for beginners to follow the state-of-the-art end-to-end planning of autonomous driving in industry and academia, as well as supplementary material for advanced researchers.


title: Generative AI and Its Educational Implications

abstract: We discuss the implications of generative AI on education across four critical sections: the historical development of AI in education, its contemporary applications in learning, societal repercussions, and strategic recommendations for researchers. We propose ways in which generative AI can transform the educational landscape, primarily via its ability to conduct assessment of complex cognitive performances and create personalized content. We also address the challenges of effective educational tool deployment, data bias, design transparency, and accurate output verification. Acknowledging the societal impact, we emphasize the need for updating curricula, redefining communicative trust, and adjusting to transformed social norms. We end by outlining the ways in which educational stakeholders can actively engage with generative AI, develop fluency with its capacities and limitations, and apply these insights to steer educational practices in a rapidly advancing digital landscape.


title: Gemini Pro Defeated by GPT-4V: Evidence from Education

abstract: This study compared the classification performance of Gemini Pro and GPT-4V in educational settings. Employing visual question answering (VQA) techniques, the study examined both models' abilities to read text-based rubrics and then automatically score student-drawn models in science education. We employed both quantitative and qualitative analyses using a dataset derived from student-drawn scientific models and employing NERIF (Notation-Enhanced Rubrics for Image Feedback) prompting methods. The findings reveal that GPT-4V significantly outperforms Gemini Pro in terms of scoring accuracy and Quadratic Weighted Kappa. The qualitative analysis reveals that the differences may be due to the models' ability to process fine-grained texts in images and overall image classification performance. Even adapting the NERIF approach by further de-sizing the input images, Gemini Pro seems not able to perform as well as GPT-4V. The findings suggest GPT-4V's superior capability in handling complex multimodal educational tasks. The study concludes that while both models represent advancements in AI, GPT-4V's higher performance makes it a more suitable tool for educational applications involving multimodal data interpretation.


title: Risk-anticipatory autonomous driving strategies considering vehicles' weights, based on hierarchical deep reinforcement learning

abstract: Autonomous vehicles (AVs) have the potential to prevent accidents caused by drivers errors and reduce road traffic risks. Due to the nature of heavy vehicles, whose collisions cause more serious crashes, the weights of vehicles need to be considered when making driving strategies aimed at reducing the potential risks and their consequences in the context of autonomous driving. This study develops an autonomous driving strategy based on risk anticipation, considering the weights of surrounding vehicles and using hierarchical deep reinforcement learning. A risk indicator integrating surrounding vehicles weights, based on the risk field theory, is proposed and incorporated into autonomous driving decisions. A hybrid action space is designed to allow for left lane changes, right lane changes and car-following, which enables AVs to act more freely and realistically whenever possible. To solve the above hybrid decision-making problem, a hierarchical proximal policy optimization (HPPO) algorithm with an attention mechanism (AT-HPPO) is developed, providing great advantages in maintaining stable performance with high robustness and generalization. An indicator, potential collision energy in conflicts (PCEC), is newly proposed to evaluate the performance of the developed AV driving strategy from the perspective of the consequences of potential accidents. The performance evaluation results in simulation and dataset demonstrate that our model provides driving strategies that reduce both the likelihood and consequences of potential accidents, at the same time maintaining driving efficiency. The developed method is especially meaningful for AVs driving on highways, where heavy vehicles make up a high proportion of the traffic.


title: Mobile Edge Generation: A New Era to 6G

abstract: A conception of mobile edge generation (MEG) is proposed, where generative artificial intelligence (GAI) models are distributed at edge servers (ESs) and user equipment (UE), enabling joint execution of generation tasks. Various distributed deployment schemes of the GAI model are proposed to alleviate the immense network load and long user queuing times for accessing GAI models. Two MEG frameworks are proposed, namely the single-ES framework and the multi-ESs framework. 1) A one-to-one joint generation framework between an ES and a UE is proposed, including four specific single-ES MEG protocols. These protocols allow distributed GAI models to transmit seeds or sketches for delivering information efficiently. 2) Several protocols are proposed for multi-ESs MEG, which enable multiple ESs to perform the generation task cooperatively or in parallel. Finally, a case study of a text-guided-image-to-image generation is provided, where a latent diffusion model is distributed at an ES and a UE. The simulation results demonstrate that the proposed protocols are able to generate high-quality images at extremely low signal-to-noise ratios. The proposed protocols can significantly reduce the communication overhead compared to the centralized model.


title: An Integrated Imitation and Reinforcement Learning Methodology for Robust Agile Aircraft Control with Limited Pilot Demonstration Data

abstract: In this paper, we present a methodology for constructing data-driven maneuver generation models for agile aircraft that can generalize across a wide range of trim conditions and aircraft model parameters. Maneuver generation models play a crucial role in the testing and evaluation of aircraft prototypes, providing insights into the maneuverability and agility of the aircraft. However, constructing the models typically requires extensive amounts of real pilot data, which can be time-consuming and costly to obtain. Moreover, models built with limited data often struggle to generalize beyond the specific flight conditions covered in the original dataset. To address these challenges, we propose a hybrid architecture that leverages a simulation model, referred to as the source model. This open-source agile aircraft simulator shares similar dynamics with the target aircraft and allows us to generate unlimited data for building a proxy maneuver generation model. We then fine-tune this model to the target aircraft using a limited amount of real pilot data. Our approach combines techniques from imitation learning, transfer learning, and reinforcement learning to achieve this objective. To validate our methodology, we utilize real agile pilot data provided by Turkish Aerospace Industries (TAI). By employing the F-16 as the source model, we demonstrate that it is possible to construct a maneuver generation model that generalizes across various trim conditions and aircraft parameters without requiring any additional real pilot data. Our results showcase the effectiveness of our approach in developing robust and adaptable models for agile aircraft.


title: Adapting Large Language Models for Education: Foundational Capabilities, Potentials, and Challenges

abstract: Online education platforms, leveraging the internet to distribute education resources, seek to provide convenient education but often fall short in real-time communication with students. They often struggle to address the diverse obstacles students encounter throughout their learning journey. Solving the problems encountered by students poses a significant challenge for traditional deep learning models, as it requires not only a broad spectrum of subject knowledge but also the ability to understand what constitutes a student's individual difficulties. It's challenging for traditional machine learning models, as they lack the capacity to comprehend students' personalized needs. Recently, the emergence of large language models (LLMs) offers the possibility for resolving this issue by comprehending individual requests. Although LLMs have been successful in various fields, creating an LLM-based education system is still challenging for the wide range of educational skills required. This paper reviews the recently emerged LLM research related to educational capabilities, including mathematics, writing, programming, reasoning, and knowledge-based question answering, with the aim to explore their potential in constructing the next-generation intelligent education system. Specifically, for each capability, we focus on investigating two aspects. Firstly, we examine the current state of LLMs regarding this capability: how advanced they have become, whether they surpass human abilities, and what deficiencies might exist. Secondly, we evaluate whether the development methods for LLMs in this area are generalizable, that is, whether these methods can be applied to construct a comprehensive educational supermodel with strengths across various capabilities, rather than being effective in only a singular aspect.


title: Zeroth-order Gradient and Quasi-Newton Methods for Nonsmooth Nonconvex Stochastic Optimization

abstract: We consider the minimization of a Lipschitz continuous and expectation-valued function defined as $f(\mathbf{x}) \triangleq \mathbb{E}[{\tilde f}(\mathbf{x}, \boldsymbol{\xi})]$, over a closed and convex set. Our focus lies on obtaining both asymptotics as well as rate and complexity guarantees for computing an approximate stationary point (in a Clarke sense) via zeroth-order schemes. We adopt a smoothing-based approach reliant on minimizing $f_{\eta}$ where $f_{\eta}(\mathbf{x}) = \mathbb{E}_{\mathbf{u}}[f(\mathbf{x}+\eta \mathbf{u})]$, $\mathbf{u}$ is a random variable defined on a unit sphere, and $\eta > 0$. It has been observed that a stationary point of the $\eta$-smoothed problem is a $2\eta$-stationary point for the original problem in the Clarke sense. In such a setting, we develop two sets of schemes with promising empirical behavior. (I) We develop a smoothing-enabled variance-reduced zeroth-order gradient framework (VRG-ZO) and make two sets of contributions for the sequence generated by the proposed zeroth-order gradient scheme. (a) The residual function of the smoothed problem tends to zero almost surely along the generated sequence, allowing for making guarantees for $\eta$-Clarke stationary solutions of the original problem; (b) To compute an $\mathbf{x}$ that ensures that the expected norm of the residual of the $\eta$-smoothed problem is within $\epsilon$ requires no greater than $O(\eta^{-1} \epsilon^{-2})$ projection steps and $ O\left(\eta^{-2} \epsilon^{-4}\right)$ function evaluations. (II) Our second scheme is a zeroth-order stochastic quasi-Newton scheme (VRSQN-ZO) reliant on a combination of randomized and Moreau smoothing; the corresponding iteration and sample complexities for this scheme are $ O\left(\eta^{-5}\epsilon^{-2}\right)$ and $ O\left(\eta^{-7}\epsilon^{-4}\right)$, respectively


title: Modeling and control of the rodwheel

abstract: The rodwheel is a wheel equipped with a rod motorized on the axle. This paper proposes a Lagrangian approach to find the state equations of the rodwheel rolling on a plane without friction. The approach takes advantage of a symbolic computation. A controller is proposed to stabilize the rodwheel with the rod upward and going straight at a desired speed.


title: Data-Driven Physics-Informed Neural Networks: A Digital Twin Perspective

abstract: This study explores the potential of physics-informed neural networks (PINNs) for the realization of digital twins (DT) from various perspectives. First, various adaptive sampling approaches for collocation points are investigated to verify their effectiveness in the mesh-free framework of PINNs, which allows automated construction of virtual representation without manual mesh generation. Then, the overall performance of the data-driven PINNs (DD-PINNs) framework is examined, which can utilize the acquired datasets in DT scenarios. Its scalability to more general physics is validated within parametric Navier-Stokes equations, where PINNs do not need to be retrained as the Reynolds number varies. In addition, since datasets can be often collected from different fidelity/sparsity in practice, multi-fidelity DD-PINNs are also proposed and evaluated. They show remarkable prediction performance even in the extrapolation tasks, with $42\sim62\%$ improvement over the single-fidelity approach. Finally, the uncertainty quantification performance of multi-fidelity DD-PINNs is investigated by the ensemble method to verify their potential in DT, where an accurate measure of predictive uncertainty is critical. The DD-PINN frameworks explored in this study are found to be more suitable for DT scenarios than traditional PINNs from the above perspectives, bringing engineers one step closer to seamless DT realization.


title: Thermodynamic Perspectives on Computational Complexity: Exploring the P vs. NP Problem

abstract: The resolution of the P vs. NP problem, a cornerstone in computational theory, remains elusive despite extensive exploration through mathematical logic and algorithmic theory. This paper takes a novel approach by integrating information theory, thermodynamics, and computational complexity, offering a comprehensive landscape of interdisciplinary study. We focus on entropy, a concept traditionally linked with uncertainty and disorder, and reinterpret it to assess the complexity of computational problems. Our research presents a structured framework for establishing entropy profiles within computational tasks, enabling a clear distinction between P and NP-classified problems. This framework quantifies the 'information cost' associated with these problem categories, highlighting their intrinsic computational complexity. We introduce Entropy-Driven Annealing (EDA) as a new method to decipher the energy landscapes of computational problems, focusing on the unique characteristics of NP problems. This method proposes a differential thermodynamic profile for NP problems in contrast to P problems and explores potential thermodynamic routes for finding polynomial-time solutions to NP challenges. Our introduction of EDA and its application to complex computational problems like the Boolean satisfiability problem (SAT) and protein-DNA complexes suggests a potential pathway toward unraveling the intricacies of the P vs. NP problem.


title: Deep Reinforcement Learning for Multi-Truck Vehicle Routing Problems with Multi-Leg Demand Routes

abstract: Deep reinforcement learning (RL) has been shown to be effective in producing approximate solutions to some vehicle routing problems (VRPs), especially when using policies generated by encoder-decoder attention mechanisms. While these techniques have been quite successful for relatively simple problem instances, there are still under-researched and highly complex VRP variants for which no effective RL method has been demonstrated. In this work we focus on one such VRP variant, which contains multiple trucks and multi-leg routing requirements. In these problems, demand is required to move along sequences of nodes, instead of just from a start node to an end node. With the goal of making deep RL a viable strategy for real-world industrial-scale supply chain logistics, we develop new extensions to existing encoder-decoder attention models which allow them to handle multiple trucks and multi-leg routing requirements. Our models have the advantage that they can be trained for a small number of trucks and nodes, and then embedded into a large supply chain to yield solutions for larger numbers of trucks and nodes. We test our approach on a real supply chain environment arising in the operations of Japanese automotive parts manufacturer Aisin Corporation, and find that our algorithm outperforms Aisin's previous best solution.


title: On the representation of fourth and higher order anisotropic elasticity tensors in generalized continuum models

abstract: The classification of all fourth order anisotropic tensor classes for classical linear elasticity is well known. We review the mathematical procedure behind this classification and extend it to fourth order elasticity tensors acting on non-symmetric matrices. These tensors naturally appear in generalised continuum models. Based on tensor-symmetrization we provide the most general form of these tensors for the case of orthotropic, transversely isotropic, cubic and isotropic materials. We give a self-contained presentation and provide a detailed calculation for simple examples.


title: DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference

abstract: The deployment and scaling of large language models (LLMs) have become critical as they permeate various applications, demanding high-throughput and low-latency serving systems. Existing frameworks struggle to balance these requirements, especially for workloads with long prompts. This paper introduces DeepSpeed-FastGen, a system that employs Dynamic SplitFuse, a novel prompt and generation composition strategy, to deliver up to 2.3x higher effective throughput, 2x lower latency on average, and up to 3.7x lower (token-level) tail latency, compared to state-of-the-art systems like vLLM. We leverage a synergistic combination of DeepSpeed-MII and DeepSpeed-Inference to provide an efficient and easy-to-use serving system for LLMs. DeepSpeed-FastGen's advanced implementation supports a range of models and offers both non-persistent and persistent deployment options, catering to diverse user scenarios from interactive sessions to long-running applications. We present a detailed benchmarking methodology, analyze the performance through latency-throughput curves, and investigate scalability via load balancing. Our evaluations demonstrate substantial improvements in throughput and latency across various models and hardware configurations. We discuss our roadmap for future enhancements, including broader model support and new hardware backends. The DeepSpeed-FastGen code is readily available for community engagement and contribution.


title: Concept Alignment

abstract: Discussion of AI alignment (alignment between humans and AI systems) has focused on value alignment, broadly referring to creating AI systems that share human values. We argue that before we can even attempt to align values, it is imperative that AI systems and humans align the concepts they use to understand the world. We integrate ideas from philosophy, cognitive science, and deep learning to explain the need for concept alignment, not just value alignment, between humans and machines. We summarize existing accounts of how humans and machines currently learn concepts, and we outline opportunities and challenges in the path towards shared concepts. Finally, we explain how we can leverage the tools already being developed in cognitive science and AI research to accelerate progress towards concept alignment.


title: Standard energy data competition procedure: A comprehensive review with a case study of the ADRENALIN load disaggregation competition

abstract: Crowdsourcing data science competitions has become popular as a cost-effective alternative to solving complex energy-related challenges. How-ever, comprehensive reviews on hosting processes remain scarce. Therefore, this paper undertakes a detailed review of 33 existing data competitions and 12 hosting platforms, complemented by an in-depth case study of the ADRENALIN load disaggregation competition. The review identifies essential elements of competition procedure, including platform selection, timeline, datasets, and submission and evaluation mechanisms. Based on proposed 16 evaluation criteria, the similarities and differences between data competition hosting platforms can be categorized into platform scoring and popularity, platform features, community engagement, open-source platforms, region-specific platforms, platform-specific purposes, and multi-purpose platforms. The case study underscores strategic planning's critical role, particularly platform selection. The case study also shows the importance of defining competition scope which influences the whole com-petition content and procedure, especially the datasets.